MMLU 5-shot
Massive Multitask Language Understanding via EleutherAI lm-evaluation-harness task mmlu, 5-shot, exact-match/accuracy style scoring.
Category: knowledgeEval type: LM-Eval runVersion: v1.0Submitted by: banana_baeee
LM-Eval run: run lm-eval-harness locally, then submit the task scores and optional artifacts to POST /api/evals/runs.
Eval Details
Scoring
Exact Match
Aggregation
Mean
Direction
Higher is better
Tasks
1 task
Leaderboard— best run per model
No approved results yet. Submit a run via the API.