File soft.cpp

↰ Parent directory (/workspace/amdinfer/src/amdinfer/batching)

Implements the soft batcher.

Definition (/workspace/amdinfer/src/amdinfer/batching/soft.cpp)

• Program Listing for File soft.cpp

Includes

• algorithm

• amdinfer/batching/soft.hpp (File soft.hpp)

• amdinfer/build_options.hpp (File build_options.hpp)

• amdinfer/core/exceptions.hpp (File exceptions.hpp)

• amdinfer/core/interface.hpp (File interface.hpp)

• amdinfer/core/predict_api.hpp (File predict_api.hpp)

• amdinfer/declarations.hpp (File declarations.hpp)

• amdinfer/observation/logging.hpp (File logging.hpp)

• amdinfer/observation/metrics.hpp (File metrics.hpp)

• amdinfer/observation/tracing.hpp (File tracing.hpp)

• amdinfer/util/queue.hpp (File queue.hpp)

• amdinfer/util/thread.hpp (File thread.hpp)

• amdinfer/util/timer.hpp (File timer.hpp)

• cstddef

• cstdint

• memory

• ratio (File declarations.hpp)

• string (File string.hpp)

• utility

• vector (File vector_buffer.cpp)

Namespaces

• Namespace amdinfer

Variables

• Variable kDefaultTimeout