Matrix runs 3
A matrix run measures prompt reading (prefill) and generation (decode) speed in one go, across several context lengths and numbers of simultaneous requests.- Qwen3.8-27B-W3Rot-INT3-Paiton-RDNA4Radeon AI Pro R9700 32GB · vllm 0.29.0 · W3A43 contexts × 2 concurrency levels
- Peak decode
- 543.7 tok/s
- Peak prefill
- 3,973 tok/s
- Qwen3.8-Flash-Next-W4A8-Paiton-RDNA4Radeon AI Pro R9700 32GB ×2 · vllm 0.29.0 · W4A81 context × 2 concurrency levels
- Peak decode
- 678.2 tok/s
- Peak prefill
- 7,121 tok/s
- Qwen3.8-Flash-Next-W3A8-Paiton-RDNA4Radeon AI Pro R9700 32GB ×2 · vllm 0.29.0 · W3A81 context × 2 concurrency levels
- Peak decode
- 745.2 tok/s
- Peak prefill
- 8,292 tok/s