Getting started
User guide
Examples
Developers
About
Libraries and API
BadStatus
Client
ConnectionError
DataType
EnvironmentNotSetError
ExternalError
FileNotFoundError
FileReadError
GrpcClient
HttpClient
ImageInferenceRequest()
InferenceRequest
InferenceRequestInput
InferenceRequestOutput
InferenceResponse
InferenceResponseOutput
InferenceTensor
InvalidArgumentError
ModelMetadata
NativeClient
ParameterMap
RuntimeError
Server
ServerMetadata
Tensor
WebSocketClient
inferAsyncOrdered()
inferAsyncOrderedBatched()
inference_request_to_dict()
loadEnsemble()
parallel_infer()
serverHasExtension()
start_http_client_server()
stringToArray()
unloadModels()
waitUntilModelNotReady()
waitUntilModelReady()
waitUntilServerReady()
The CPlusPlus backend can run arbitrary C++ code targeting any hardware accelerator that adheres to the interface.