Models Leaderboard Hardware Marketplace Evals Train Rentals API Docs

Language

RTX 3090 + RTX 4090 (2x)

All approved runs for this hardware, sortable to find fastest model results.

#	Hardware	Engine · Quant	Ctx	tok/s out	prefill	tok/s total	TTFT ms	VRAM GB