Backends¶
The AMD Inference Server supports a number of backends. Each backend has its own sets of features and capabilities, which are summarized at a high-level in the table below. You can see more information about each backend on its own page.
Backend |
Hardware |
Model Formats |
Model Support |
---|---|---|---|
CPU | GPU | FPGA |
.so |
✔ |
|
GPU |
.mxr | .onnx |
✔ |
|
CPU |
.pt |
⚠ |
|
CPU |
.tf |
⚠ |
|
FPGA |
.xmodel |
✔ |