Get startedLeaderboardDecode calculatorModelsReportsHardwareBenchmarksMarketplaceRentalsProAPI Docs
Language
Actual Computer — Every computer, one endpoint

Observed performance

Run snapshot

All runs matching the filters below.
Fastest run
Median speed
Memory ceiling
Slowest run
Measured runs
Llama-2-7b (7B) — 110.1 tok/s top speed | LocalMaxxing