LLMs on NPU¶
End-to-end decoder-only LLM inference (prefill + autoregressive decode) mapped to the AMD NPU2 in bf16 via MLIR-AIR. Model coverage and performance below are refreshed nightly by CI (correctness verify plus TTFT/decode capture). For per-model architecture details and source, see the programming_examples/llms/ directory.