stories-llama2-50k — 306.1K tok/s top speed | Localmaxxing

Начало работы Таблица лидеров Decode calculator Модели Reports Оборудование Бенчмарки Маркетплейс Аренда Pro Документация API

Язык

Observed performance

Run snapshot

Current results after the filters below are applied.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

Community leaderboard

Speed test results

Compare real runs across hardware, engines, contexts, and quantizations.

Submit benchmark

Observed performance

Run snapshot

Current results after the filters below are applied.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

#	Оборудование	Движок	Глубина	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

stories-llama2-50k — 306.1K tok/s top speed | Localmaxxing