Premiers pasClassementDecode calculatorModèlesOrganizationsReportsMatrix runsMatérielÉvaluations comparativesMarketplaceLocationsProDocs API
Langue
Actual Computer — Every computer, one endpoint

Matrix runs

A matrix run measures prompt reading (prefill) and generation (decode) speed in one go, across several context lengths and numbers of simultaneous requests. Run one with lmx speed-test matrix run.

Clear

Matching runs 699

Submitted by @keennay. Newest first. Page 12 of 28.
  • LFM2.5-350MH200 NVL 141GB · sglang 0.5.6.post3.dev9265+g05c584c44 · BF165 contexts × 8 concurrency levels
    Peak decode
    2,584.4 tok/s
    Peak prefill
    189.8K tok/s
  • North-Mini-Code-1.0H200 NVL 141GB · vllm 0.26.1rc1.dev638+g52be12cfa · BF167 contexts × 8 concurrency levels
    Peak decode
    4,032.8 tok/s
    Peak prefill
    39.4K tok/s
  • Qwen3.6-35B-A3B-NVFP4H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · NVFP4+FP86 contexts × 8 concurrency levels
    Peak decode
    5,952.1 tok/s
    Peak prefill
    36.3K tok/s
  • Qwen3.6-27B-NVFP4H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · NVFP4+FP86 contexts × 8 concurrency levels
    Peak decode
    913.1 tok/s
    Peak prefill
    6,368 tok/s
  • Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · NVFP4+FP86 contexts × 8 concurrency levels
    Peak decode
    4,544.9 tok/s
    Peak prefill
    31K tok/s
  • Nemotron-3-Nano-Omni-30B-A3B-Reasoning-FP8H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · FP86 contexts × 8 concurrency levels
    Peak decode
    4,377.6 tok/s
    Peak prefill
    45.6K tok/s
  • Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · BF166 contexts × 8 concurrency levels
    Peak decode
    3,619.5 tok/s
    Peak prefill
    31.7K tok/s
  • NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · NVFP4+FP88 contexts × 8 concurrency levels
    Peak decode
    4,199.0 tok/s
    Peak prefill
    29.2K tok/s
  • NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4H200 NVL 141GB · sglang 0.0.0.dev17157+gccfcdd93a · NVFP4+FP88 contexts × 8 concurrency levels
    Peak decode
    2,297.0 tok/s
    Peak prefill
    29.1K tok/s
  • NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4H200 NVL 141GB · sglang 0.0.0.dev17157+gccfcdd93a · NVFP4+FP88 contexts × 8 concurrency levels
    Peak decode
    2,024.8 tok/s
    Peak prefill
    29.1K tok/s
  • NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · BF168 contexts × 8 concurrency levels
    Peak decode
    4,501.9 tok/s
    Peak prefill
    19.8K tok/s
  • NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · NVFP4+FP88 contexts × 8 concurrency levels
    Peak decode
    1,053.8 tok/s
    Peak prefill
    9,989 tok/s
  • NVIDIA-Nemotron-3-Super-120B-A12B-BF16H200 NVL 141GB ×2 · sglang 0.5.6.post3.dev9335+gdd15fb57b · BF168 contexts × 8 concurrency levels
    Peak decode
    486.7 tok/s
    Peak prefill
    10.5K tok/s
  • DeepSeek-V4-Flash-nvfp4-DSparkH200 NVL 141GB ×2 · sglang 0.5.16 · NVFP4+FP88 contexts × 8 concurrency levels
    Peak decode
    757.8 tok/s
    Peak prefill
    14.7K tok/s
  • DeepSeek-V4-Flash-NVFP4H200 NVL 141GB ×2 · sglang 0.5.16 · NVFP4+FP88 contexts × 8 concurrency levels
    Peak decode
    266.0 tok/s
    Peak prefill
    14.9K tok/s
  • Shieldstral-1.0-3BH200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · BF163 contexts × 8 concurrency levels
    Peak decode
    3,378.6 tok/s
    Peak prefill
    51.7K tok/s
  • Mistral-Medium-3.5-128BH200 NVL 141GB ×2 · sglang 0.5.6.post3.dev9335+gdd15fb57b · FP86 contexts × 8 concurrency levels
    Peak decode
    627.8 tok/s
    Peak prefill
    5,218 tok/s
  • Mistral-Medium-3.5-128BH200 NVL 141GB ×2 · sglang 0.5.6.post3.dev9335+gdd15fb57b · FP86 contexts × 8 concurrency levels
    Peak decode
    394.2 tok/s
    Peak prefill
    5,063 tok/s
  • Ministral-3-8B-Reasoning-2512H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · BF166 contexts × 8 concurrency levels
    Peak decode
    2,313.9 tok/s
    Peak prefill
    28.7K tok/s
  • Ministral-3-8B-Instruct-2512H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · FP86 contexts × 8 concurrency levels
    Peak decode
    2,523.4 tok/s
    Peak prefill
    37.9K tok/s
  • Ministral-3-3B-Reasoning-2512H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · BF166 contexts × 8 concurrency levels
    Peak decode
    3,367.8 tok/s
    Peak prefill
    50.1K tok/s
  • Ministral-3-3B-Instruct-2512H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · FP86 contexts × 8 concurrency levels
    Peak decode
    4,140.9 tok/s
    Peak prefill
    62.1K tok/s
  • Ministral-3-3B-Base-2512H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · BF166 contexts × 8 concurrency levels
    Peak decode
    3,375.0 tok/s
    Peak prefill
    47.5K tok/s
  • Ministral-3-14B-Instruct-2512H200 NVL 141GB · sglang 0.5.6.post3.dev9335+gdd15fb57b · FP86 contexts × 8 concurrency levels
    Peak decode
    2,031.7 tok/s
    Peak prefill
    26.4K tok/s
  • Muse-Glimmer-30BH200 NVL 141GB · sglang 0.5.6.post3.dev9265+g05c584c44 · BF165 contexts × 8 concurrency levels
    Peak decode
    2,616.6 tok/s
    Peak prefill
    10.4K tok/s