Template Class InferenceRequestBuilder

Class Documentation

template<typename T>
class InferenceRequestBuilder

Public Static Functions

static InferenceRequestPtr build(T req, size_t &buffer_index, const std::vector<BufferRawPtrs> &input_buffers, std::vector<size_t> &input_offsets, const std::vector<BufferRawPtrs> &output_buffers, std::vector<size_t> &output_offsets, const size_t &batch_size, size_t &batch_offset)

Construct a new InferenceRequest object.

Parameters

  • req – some valid type holding data

  • buffer_index – current buffer index to start with for the buffers

  • input_buffers – a vector of input buffers to store the inputs data

  • input_offsets – a vector of offsets for the input buffers to store data

  • output_buffers – a vector of output buffers

  • output_offsets – a vector of offsets for the output buffers

  • batch_size – batch size to use when creating the request

  • batch_offset – current batch offset to start with