Premiers pasClassementDecode calculatorModèlesOrganizationsReportsMatrix runsMatérielÉvaluations comparativesMarketplaceLocationsProDocs API
Langue
Actual Computer — Every computer, one endpoint

Matrix runs

A matrix run measures prompt reading (prefill) and generation (decode) speed in one go, across several context lengths and numbers of simultaneous requests. Run one with lmx speed-test matrix run.

All runs 1,102

Newest first. Page 31 of 45.
  • Trinity-Large-PreviewH200 SXM 141GB ×8 · vllm 0.29.0 · BF167 contexts × 8 concurrency levels
    Peak decode
    3,152.1 tok/s
    Peak prefill
    46.6K tok/s
    by @keennay
  • GLM-5.3-FlashH200 SXM 141GB ×4 · sglang 0.5.6.post3.dev10338+g787299797 · FP88 contexts × 8 concurrency levels
    Peak decode
    2,302.9 tok/s
    Peak prefill
    22.3K tok/s
    by @keennay
  • Kimi-K2.6-NVFP4H200 SXM 141GB ×8 · vllm 0.29.0 · NVFP46 contexts × 8 concurrency levels
    Peak decode
    630.8 tok/s
    Peak prefill
    18.7K tok/s
    by @keennay
  • Kimi-K2.5H200 SXM 141GB ×8 · vllm 0.29.0 · INT46 contexts × 8 concurrency levels
    Peak decode
    711.4 tok/s
    Peak prefill
    18.8K tok/s
    by @keennay
  • Kimi-K2.5-NVFP4H200 SXM 141GB ×8 · vllm 0.29.0 · NVFP46 contexts × 8 concurrency levels
    Peak decode
    603.0 tok/s
    Peak prefill
    17.8K tok/s
    by @keennay
  • Kimi-K2.7-Code-NVFP4H200 SXM 141GB ×8 · vllm 0.29.0 · NVFP46 contexts × 8 concurrency levels
    Peak decode
    620.1 tok/s
    Peak prefill
    18.7K tok/s
    by @keennay
  • Kimi-K2.6H200 SXM 141GB ×8 · vllm 0.29.0 · INT46 contexts × 8 concurrency levels
    Peak decode
    686.5 tok/s
    Peak prefill
    18.8K tok/s
    by @keennay
  • Kimi-K2.5H200 SXM 141GB ×8 · vllm 0.29.0 · INT46 contexts × 8 concurrency levels
    Peak decode
    340.4 tok/s
    Peak prefill
    18.8K tok/s
    by @keennay
  • Kimi-K2.5H200 SXM 141GB ×8 · vllm 0.29.0 · INT46 contexts × 8 concurrency levels
    Peak decode
    410.4 tok/s
    Peak prefill
    18.8K tok/s
    by @keennay
  • MiniMax-M2.5H200 SXM 141GB ×4 · vllm 0.29.0 · FP86 contexts × 8 concurrency levels
    Peak decode
    3,962.4 tok/s
    Peak prefill
    32.9K tok/s
    by @keennay
  • MiniMax-M2.7H200 SXM 141GB ×4 · vllm 0.29.0 · FP86 contexts × 8 concurrency levels
    Peak decode
    1,264.3 tok/s
    Peak prefill
    35.1K tok/s
    by @keennay
  • MiniMax-M3-MXFP8H200 SXM 141GB ×8 · vllm 0.29.0 · MXFP88 contexts × 8 concurrency levels
    Peak decode
    629.0 tok/s
    Peak prefill
    18.8K tok/s
    by @keennay
  • MiniMax-M3H200 SXM 141GB ×8 · vllm 0.29.0 · BF166 contexts × 8 concurrency levels
    Peak decode
    181.2 tok/s
    Peak prefill
    26.9K tok/s
    by @keennay
  • Step-3.5-FlashH200 SXM 141GB ×4 · vllm 0.29.0 · BF166 contexts × 8 concurrency levels
    Peak decode
    4,673.1 tok/s
    Peak prefill
    35K tok/s
    by @keennay
  • Step-3.7-FlashH200 SXM 141GB ×4 · vllm 0.29.0 · BF166 contexts × 8 concurrency levels
    Peak decode
    4,829.4 tok/s
    Peak prefill
    35.5K tok/s
    by @keennay
  • Kimi-K2.7-CodeH200 SXM 141GB ×8 · vllm 0.29.0 · INT46 contexts × 8 concurrency levels
    Peak decode
    366.5 tok/s
    Peak prefill
    18.7K tok/s
    by @keennay
  • Kimi-K2.6H200 SXM 141GB ×8 · vllm 0.29.0 · INT46 contexts × 8 concurrency levels
    Peak decode
    398.9 tok/s
    Peak prefill
    18.7K tok/s
    by @keennay
  • GLM-5.3-Flash-NVFP4H200 SXM 141GB ×4 · sglang 0.5.6.post3.dev10338+g787299797 · NVFP48 contexts × 8 concurrency levels
    Peak decode
    4,782.9 tok/s
    Peak prefill
    17.6K tok/s
    by @keennay
  • GLM-5.3-Flash-NVFP4H200 SXM 141GB ×4 · vllm · NVFP48 contexts × 8 concurrency levels
    Peak decode
    1,798.9 tok/s
    Peak prefill
    14.3K tok/s
    by @keennay
  • GLM-5.3-NVFP4H200 SXM 141GB ×8 · sglang 0.5.6.post3.dev10338+g787299797 · NVFP47 contexts × 8 concurrency levels
    Peak decode
    1,513.7 tok/s
    Peak prefill
    9,689 tok/s
    by @keennay
  • GLM-5.3-NVFP4H200 SXM 141GB ×8 · vllm 0.29.0 · NVFP47 contexts × 8 concurrency levels
    Peak decode
    1,561.6 tok/s
    Peak prefill
    10.2K tok/s
    by @keennay
  • GLM-5.3-MXFP4H200 SXM 141GB ×8 · vllm 0.29.0 · MXFP47 contexts × 8 concurrency levels
    Peak decode
    1,459.2 tok/s
    Peak prefill
    8,942 tok/s
    by @keennay
  • GLM-5.3-NVFP4H200 SXM 141GB ×8 · sglang 0.5.6.post3.dev10338+g787299797 · NVFP47 contexts × 8 concurrency levels
    Peak decode
    1,466.0 tok/s
    Peak prefill
    9,696 tok/s
    by @keennay
  • GLM-5.3-NVFP4H200 SXM 141GB ×8 · sglang 0.5.6.post3.dev10338+g787299797 · NVFP47 contexts × 8 concurrency levels
    Peak decode
    1,471.1 tok/s
    Peak prefill
    9,724 tok/s
    by @keennay
  • GLM-5.3-Flash-NVFP4H200 SXM 141GB ×4 · sglang 0.5.6.post3.dev10338+g787299797 · NVFP48 contexts × 8 concurrency levels
    Peak decode
    2,480.0 tok/s
    Peak prefill
    16.5K tok/s
    by @keennay