Source · Vals AI Version · vals-ai snapshot 2026-10-03 Scores · 43
Test details
Visible tradeoffsThis is an objective signal, so it is mainly about measurable task performance rather than public taste.
source
Vals AI
metric
Accuracy (%)
judge
Objective
direction
higher better
group id
vals_proof_bench_current
domain
Reasoning / math / science
What it measures vs what it misses
✓ Measures
Writing math proofs that can be formally verified.
✗ Misses
Adjacent skills outside the benchmark task mix, latency, and cost.
Why this countsIt is one of the cleaner reads on deliberate reasoning strength rather than style or popularity.Same-test ruleThis percentile only compares models inside the exact benchmark/version group shown here. It is not a universal score.What it missesIt still misses product usability, latency, and whether the model stays correct in messy real workflows.
Leaderboard · this benchmark version
#1 · Claude Sonnet 5.5 (Adaptive Reasoning, Max Effort, Default Fallback)