alert
13 review items still need manual judgment
The product keeps parser and mapping ambiguity visible instead of silently guessing.
Operational history
Changelog
Parser changes, mapping fixes, methodology changes, and product releases stay visible because data plumbing changes what the site appears to know.
What changed this week
sources
Artificial Analysis moved via source updated leaderboard
The saved raw source snapshot changed relative to the previous run. Window: 2026-10-03T11:41:25Z -> 2026-10-03T11:42:08Z.
models
BridgeBench moved via new benchmark coverage
10 benchmark rows were added, 10 removed, and 0 existing rows changed value or evaluation date. Window: 2026-05-15T16:26:59Z -> 2026-05-15T16:34:46Z.
sources
Scale Labs moved via source updated leaderboard
The saved raw source snapshot changed relative to the previous run. Window: 2026-10-03T11:41:42Z -> 2026-10-03T11:42:34Z.
product
Initial comparison-table release
Added comparison-table homepage, same-test normalization, per-cell source links, source pages, and custom-ranking preview.
models
Methodology contract published
Documented comparability rules, raw-vs-normalized behavior, and why unlike metrics are never averaged by default.
models
Artificial Analysis ID rule adopted
Stable model and creator IDs are now the preferred external identity keys when available.
models
BridgeBench parser fallback added
Added alternate selectors for category headers after leaderboard markup drift.
2026-04-16
product
Initial comparison-table release Added comparison-table homepage, same-test normalization, per-cell source links, source pages, and custom-ranking preview.
2026-04-16
methodology
Methodology contract published Documented comparability rules, raw-vs-normalized behavior, and why unlike metrics are never averaged by default.
2026-04-15
mapping
Artificial Analysis ID rule adopted Stable model and creator IDs are now the preferred external identity keys when available.
2026-04-15
parser
BridgeBench parser fallback added Added alternate selectors for category headers after leaderboard markup drift.
2026-04-16
parser
LiveBench worker now feeds app bundle LiveBench records are now generated from the official public leaderboard dataset and merged into the catalog as a checked-in fragment with snapshot and parser metadata.
2026-04-16
mapping
Provider model registry added Current-model coverage now merges a generated registry sourced from official provider docs, with per-model verification links and a review queue for newly discovered names.
2026-04-16
methodology
Current models separated from historical benchmark identities New provider-verified variants such as GPT-5.4 and Claude Sonnet 4.5 now remain distinct from older benchmarked IDs so legacy scores are not silently relabeled as newer models.
What changed this week
alert
13 review items still need manual judgment
The product keeps parser and mapping ambiguity visible instead of silently guessing.
sources
Artificial Analysis moved via source updated leaderboard
The saved raw source snapshot changed relative to the previous run. Window: 2026-10-03T11:41:25Z -> 2026-10-03T11:42:08Z.
models
BridgeBench moved via new benchmark coverage
10 benchmark rows were added, 10 removed, and 0 existing rows changed value or evaluation date. Window: 2026-05-15T16:26:59Z -> 2026-05-15T16:34:46Z.
sources
Scale Labs moved via source updated leaderboard
The saved raw source snapshot changed relative to the previous run. Window: 2026-10-03T11:41:42Z -> 2026-10-03T11:42:34Z.
product
Initial comparison-table release
Added comparison-table homepage, same-test normalization, per-cell source links, source pages, and custom-ranking preview.
models
Methodology contract published
Documented comparability rules, raw-vs-normalized behavior, and why unlike metrics are never averaged by default.
models
Artificial Analysis ID rule adopted
Stable model and creator IDs are now the preferred external identity keys when available.
models
BridgeBench parser fallback added
Added alternate selectors for category headers after leaderboard markup drift.