Benchmarks · /benchmarks/bridgebench-cost-strict

Cost strict

Name: Cost strict
Creator: BridgeBench

BridgeBench cost benchmark strict success column.

Source · BridgeBench
Version · bridgebench snapshot 2026-05-15
Scores · 1

Test details

Verified but agingThis is an efficiency signal, so it belongs beside quality rather than being mistaken for quality.

source

BridgeBench

metric

Strict (%)

judge

Speed / cost

direction

higher better

group id

bridgebench_cost_strict_2026_05

domain

Coding

What it measures vs what it misses

✓ Measures

Strict success rate for the cost benchmark's evaluated tasks.

✗ Misses

Broader capability beyond the cost-task set.

Why this countsIt tells you whether the model can generate, repair, and reason over code under evaluator pressure rather than marketing examples.Same-test ruleThis percentile only compares models inside the exact benchmark/version group shown here. It is not a universal score.What it missesIt does not fully capture repo-scale iteration, IDE ergonomics, or long debugging loops.

Leaderboard · this benchmark version

#1 · Grok 4.3

BB · May 1, 2026

Source label: openrouter/x-ai/grok-4.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.bridgebench.ai/cost
Percentile: 100%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from the BridgeBench page for bridgebench-cost-strict.

100%

Benchmarks · /benchmarks/bridgebench-cost-strict

Cost strict

BridgeBench cost benchmark strict success column.

Source · BridgeBench
Version · bridgebench snapshot 2026-05-15
Scores · 1

Test details

Verified but agingThis is an efficiency signal, so it belongs beside quality rather than being mistaken for quality.

source

BridgeBench

metric

Strict (%)

judge

Speed / cost

direction

higher better

group id

bridgebench_cost_strict_2026_05

domain

Coding

What it measures vs what it misses

✓ Measures

Strict success rate for the cost benchmark's evaluated tasks.

✗ Misses

Broader capability beyond the cost-task set.

Leaderboard · this benchmark version

#1 · Grok 4.3

BB · May 1, 2026

Source label: openrouter/x-ai/grok-4.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.bridgebench.ai/cost
Percentile: 100%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from the BridgeBench page for bridgebench-cost-strict.

100%

Cost strict

Test details

What it measures vs what it misses

✓ Measures

✗ Misses

Leaderboard · this benchmark version

Loading benchmark evidence.

Cost strict

Test details

What it measures vs what it misses

✓ Measures

✗ Misses

Leaderboard · this benchmark version