Source · Vals AI Version · vals-ai snapshot 2026-06-24 Scores · 28
Test details
Verified but agingThis is an objective signal, so it is mainly about measurable task performance rather than public taste.
source
Vals AI
metric
Accuracy (%)
judge
Objective
direction
higher better
group id
vals_terminal_bench_2_1_current
domain
Coding
What it measures vs what it misses
✓ Measures
Difficult terminal-based agent tasks.
✗ Misses
Adjacent skills outside the benchmark task mix, latency, and cost.
Why this countsIt tells you whether the model can generate, repair, and reason over code under evaluator pressure rather than marketing examples.Same-test ruleThis percentile only compares models inside the exact benchmark/version group shown here. It is not a universal score.What it missesIt does not fully capture repo-scale iteration, IDE ergonomics, or long debugging loops.