Class GrpcApiUnary

Inheritance Relationships

Base Type

Class Documentation

class GrpcApiUnary : public amdinfer::Interface

Public Functions

inline explicit GrpcApiUnary(CallDataModelInfer *calldata)

Construct a new DrogonHttp object.

Parameters

  • req –

  • callback –

inline virtual std::shared_ptr<InferenceRequest> getRequest(const BufferRawPtrs &input_buffers, std::vector<size_t> &input_offsets, const BufferRawPtrs &output_buffers, std::vector<size_t> &output_offsets) override

Construct an InferenceRequest using the data in the Interface.

Parameters

  • input_buffers – a vector of buffers to hold the input data

  • input_offsets – offsets of where to start storing input data

  • output_buffers – a vector of buffers to hold the output data

  • output_offsets – offsets of where to start storing output data

Returns

std::shared_ptr<InferenceRequest>

inline virtual size_t getInputSize() override

Get the number of input tensors in the request.

inline virtual void errorHandler(const std::exception &e) override

Given an exception, handle the exception appropriately.

Parameters

e – the raised exception