Class HardBatcher¶

Defined in File hard.hpp

Inheritance Relationships¶

Base Type¶

public amdinfer::Batcher (Class Batcher)

Class Documentation¶

class HardBatcher : public amdinfer::Batcher ¶

The HardBatcher batches to a multiple of the requested batch size and blocks until a valid batch forms. Note: this batcher is only meant for testing purposes or if the batch size is fixed to be one since it can block indefinitely.

Public Functions

Batcher()¶

Construct a new Batcher object.

The C++ Interface class encapsulates incoming requests from the C++ API to the batcher.

explicit Batcher(RequestParameters *parameters)¶

Batcher(const Batcher &batcher)¶

Construct a new Batcher object.

Parameters: name – the endpoint corresponding to the batcher’s worker group copy constructor

Batcher(Batcher &&other) = delete¶: Move constructor.