Matrix runs
A matrix run measures prompt reading (prefill) and generation (decode) speed in one go, across several context lengths and numbers of simultaneous requests. Run one with lmx speed-test matrix run.
All runs 1,102
Newest first. Page 17 of 45.- Qwen3.6-35B-A3BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · INT46 contexts × 5 concurrency levels
- Peak decode
- 833.4 tok/s
- Peak prefill
- 12.3K tok/s
- Qwen3.6-35B-A3BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · FP86 contexts × 5 concurrency levels
- Peak decode
- 1,030.5 tok/s
- Peak prefill
- 12.8K tok/s
- Peak decode
- 855.6 tok/s
- Peak prefill
- 11.9K tok/s
- Qwen3.6-27BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · INT46 contexts × 5 concurrency levels
- Peak decode
- 471.7 tok/s
- Peak prefill
- 3,752 tok/s
- Qwen3.8-27B-W3Rot-INT3-Paiton-RDNA4Radeon AI Pro R9700 32GB · vllm 0.29.0 · W3A43 contexts × 2 concurrency levels
- Peak decode
- 543.7 tok/s
- Peak prefill
- 3,973 tok/s
- Qwen3.6-27BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · FP86 contexts × 5 concurrency levels
- Peak decode
- 626.7 tok/s
- Peak prefill
- 3,858 tok/s
- Peak decode
- 396.1 tok/s
- Peak prefill
- 3,709 tok/s
- Peak decode
- 760.9 tok/s
- Peak prefill
- 6,326 tok/s
- Qwen3.8-Flash-Next-W4A8-Paiton-RDNA4Radeon AI Pro R9700 32GB ×2 · vllm 0.29.0 · W4A81 context × 2 concurrency levels
- Peak decode
- 678.2 tok/s
- Peak prefill
- 7,121 tok/s
- Qwen3.8-Flash-Next-W3A8-Paiton-RDNA4Radeon AI Pro R9700 32GB ×2 · vllm 0.29.0 · W3A81 context × 2 concurrency levels
- Peak decode
- 745.2 tok/s
- Peak prefill
- 8,292 tok/s
- Qwen3.8-Flash-Next-W4A16Intel Arc Pro B65 32GB ×4 · vllm 0.30.0 · INT4_W4A166 contexts × 3 concurrency levels
- Peak decode
- 243.2 tok/s
- Peak prefill
- 3,229 tok/s
- Qwen3.8-Flash-Next-W4A16Intel Arc Pro B65 32GB ×4 · vllm 0.30.0 · INT4_W4A166 contexts × 3 concurrency levels
- Peak decode
- 159.2 tok/s
- Peak prefill
- 3,513 tok/s
- Qwen3.8-27BRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 1,322.3 tok/s
- Peak prefill
- 8,440 tok/s
- Qwen3.8-27BRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 2,447.8 tok/s
- Peak prefill
- 8,591 tok/s
- Qwen3.6-35B-A3BRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 3,960.1 tok/s
- Peak prefill
- 32K tok/s
- Qwen3.6-35B-A3BRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 4,551.0 tok/s
- Peak prefill
- 31.4K tok/s
- Qwen3.6-27BRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 2,108.1 tok/s
- Peak prefill
- 8,398 tok/s
- Qwen3.6-27BRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 2,450.7 tok/s
- Peak prefill
- 8,599 tok/s
- Qwen3.5-35B-A3BRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 3,972.8 tok/s
- Peak prefill
- 32K tok/s
- Qwen3.5-35B-A3BRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 4,517.0 tok/s
- Peak prefill
- 31.4K tok/s
- Qwen3.5-35B-A3B-BaseRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 3,367.7 tok/s
- Peak prefill
- 31.9K tok/s
- Qwen3.5-35B-A3B-BaseRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 4,240.3 tok/s
- Peak prefill
- 32K tok/s
- Qwen3.5-27BRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 2,208.6 tok/s
- Peak prefill
- 8,403 tok/s
- Qwen3.5-27BRTX PRO 6000 Blackwell Server Edition 96GB ×2 · vllm 0.30.1rc1.dev452+g73a583112 · BF166 contexts × 8 concurrency levels
- Peak decode
- 2,451.6 tok/s
- Peak prefill
- 8,620 tok/s
- Qwen3.6-35B-A3B-TT-Mixed-BFP4-BFP8-P150Tenstorrent P150 32GB · vllm 0.1.dev14187+g03fa3af2e · BFP46 contexts × 5 concurrency levels
- Peak decode
- 628.5 tok/s
- Peak prefill
- 2,014 tok/s