Meta-Llama-3.1-70B-Instruct-AWQ-INT4 (70B) — 267.7 tok/s top speed | LocalMaxxing

Premiers pas Classement Decode calculator Modèles Organizations Reports Matrix runs Matériel Évaluations comparatives Marketplace Locations Pro Docs API

Langue

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

Community leaderboard

Speed test results

Compare real runs across hardware, engines, contexts, and quantizations.

Envoyer un test de vitesse

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

#	Matériel	Moteur	Profondeur	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

Meta-Llama-3.1-70B-Instruct-AWQ-INT4 (70B) — 267.7 tok/s top speed | LocalMaxxing