Model vs model

GPT-5.4 mini vs Agnes 2.5 Pro Alpha

A debate-ready pair page: current winner, strongest alternative, decisive benchmarks, and the warning that should travel with the claim.

Use case · Everyday chatbot
Winner · GPT-5.4 mini
Sources · All public sources

Winner

GPT-5.4 mini

OpenAI

17benchmarks won

Professional reasoning
Coding

Versus · Everyday chatbot

GPT-5.4 mini leads this compare set for everyday chatbot.

GPT-5.4 mini17 of 17 wins

Verified but aging

0 shared benchmarks are still too close to call, so the win stays conditional. This compare uses all public sources, with provider-official evidence labeled separately.

Close calls: 0
Sources: All public

Full compare workspace Disagreement page

100%win share

Challenger

Agnes 2.5 Pro Alpha

Unknown

0benchmarks won

Reasoning / math / science

The cases in full

GPT-5.4 mini case

Professional reasoning
Coding

Agnes 2.5 Pro Alpha case

Reasoning / math / science

What changes the outcome

GPT-5.4 mini: 33 visible benchmark gaps still leave room for the result to move.
Agnes 2.5 Pro Alpha: 121 visible benchmark gaps still leave room for the result to move.

Why this result is surprising

The visible shared evidence is more decisive than usual for this compare set.
Very few shared benchmarks are decisively separating these models.

Why this is not a clean win

0 shared benchmarks are still too close to call, so the win stays conditional. This compare uses all public sources, with provider-official evidence labeled separately.
Agnes 2.5 Pro Alpha remains the strongest alternative once you change use case, mode, or missing-evidence assumptions.

Open full compare workspace Open evidence page Open disagreement page

Decisive benchmarks

17 of 138 benchmarks


Intelligence Index AA · index Text · Chat / text	1452.6% exact aliasverified runtime Row details Raw value 14 Percentile 52.6% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5 mini (minimal) Source row	40n/a exact aliasverified runtimeContext only Row details Raw value 40 Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Time to first token AA · s Text · Chat / text	89.37s4.5% exact aliasverified runtime Row details Raw value 89.37s Percentile 4.5% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5 mini (high) Source row	2.09sn/a exact aliasverified runtimeContext only Row details Raw value 2.09s Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Coding Index AA · index Code · Coding	1620.7% exact aliasverified runtime Row details Raw value 16 Percentile 20.7% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5 mini (high) Source row	59n/a exact aliasverified runtimeContext only Row details Raw value 59 Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Agentic Index AA · index Code · Coding	2043.6% exact aliasverified runtime Row details Raw value 20 Percentile 43.6% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5 mini (high) Source row	25n/a exact aliasverified runtimeContext only Row details Raw value 25 Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Output Speed AA · tokens/s Text · Chat / text	82 tokens/s44.2% exact aliasverified runtime Row details Raw value 82 tokens/s Percentile 44.2% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5 mini (high) Source row	132 tokens/sn/a exact aliasverified runtimeContext only Row details Raw value 132 tokens/s Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Time to first answer token AA · s Text · Chat / text	89.37s5.8% exact aliasverified runtime Row details Raw value 89.37s Percentile 5.8% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5 mini (high) Source row	17.24sn/a exact aliasverified runtimeContext only Row details Raw value 17.24s Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Blended price AA · /1M tokens Text · Chat / text	$1.7 /1M tokens30.9% exact aliasverified runtime Row details Raw value $1.7 /1M tokens Percentile 30.9% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 mini (xhigh) Source row	$0.6 /1M tokensn/a exact aliasverified runtimeContext only Row details Raw value $0.6 /1M tokens Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Input price AA · /1M input tokens Text · Chat / text	$0.8 /1M input tokens35.5% exact aliasverified runtime Row details Raw value $0.8 /1M input tokens Percentile 35.5% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 mini (xhigh) Source row	$0.5 /1M input tokensn/a exact aliasverified runtimeContext only Row details Raw value $0.5 /1M input tokens Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Output price AA · /1M output tokens Text · Chat / text	$4.5 /1M output tokens26.6% exact aliasverified runtime Row details Raw value $4.5 /1M output tokens Percentile 26.6% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 mini (xhigh) Source row	$0.9 /1M output tokensn/a exact aliasverified runtimeContext only Row details Raw value $0.9 /1M output tokens Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
GPQA AA · % Text · Reasoning / math / science	60.6%44.1% exact aliasverified runtime Row details Raw value 60.6% Percentile 44.1% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 mini (Non-Reasoning) Source row	87.6%n/a exact aliasverified runtimeContext only Row details Raw value 87.6% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Humanity's Last Exam AA · % Text · Reasoning / math / science	5.1%39.6% exact aliasverified runtime Row details Raw value 5.1% Percentile 39.6% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5 mini (minimal) Source row	33.6%n/a exact aliasverified runtimeContext only Row details Raw value 33.6% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
CritPt AA · % Text · Reasoning / math / science	0%60.3% exact aliasverified runtime Row details Raw value 0% Percentile 60.3% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5 mini (minimal) Source row	10.9%n/a exact aliasverified runtimeContext only Row details Raw value 10.9% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a

1-12 of 17

Page 1 of 2Page size

Intelligence Index

AA · index

Text · Chat / text

1452.6%

exact aliasverified runtime

Row details

Raw value: 14
Percentile: 52.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5 mini (minimal)

Source row

40n/a

exact aliasverified runtimeContext only

Row details

Raw value: 40
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Time to first token

AA · s

Text · Chat / text

89.37s4.5%

exact aliasverified runtime

Row details

Raw value: 89.37s
Percentile: 4.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5 mini (high)

Source row

2.09sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 2.09s
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Coding Index

AA · index

Code · Coding

1620.7%

exact aliasverified runtime

Row details

Raw value: 16
Percentile: 20.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5 mini (high)

Source row

59n/a

exact aliasverified runtimeContext only

Row details

Raw value: 59
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Agentic Index

AA · index

Code · Coding

2043.6%

exact aliasverified runtime

Row details

Raw value: 20
Percentile: 43.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5 mini (high)

Source row

25n/a

exact aliasverified runtimeContext only

Row details

Raw value: 25
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Output Speed

AA · tokens/s

Text · Chat / text

82 tokens/s44.2%

exact aliasverified runtime

Row details

Raw value: 82 tokens/s
Percentile: 44.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5 mini (high)

Source row

132 tokens/sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 132 tokens/s
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Time to first answer token

AA · s

Text · Chat / text

89.37s5.8%

exact aliasverified runtime

Row details

Raw value: 89.37s
Percentile: 5.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5 mini (high)

Source row

17.24sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 17.24s
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Blended price

AA · /1M tokens

Text · Chat / text

$1.7 /1M tokens30.9%

exact aliasverified runtime

Row details

Raw value: $1.7 /1M tokens
Percentile: 30.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 mini (xhigh)

Source row

$0.6 /1M tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $0.6 /1M tokens
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Input price

AA · /1M input tokens

Text · Chat / text

$0.8 /1M input tokens35.5%

exact aliasverified runtime

Row details

Raw value: $0.8 /1M input tokens
Percentile: 35.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 mini (xhigh)

Source row

$0.5 /1M input tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $0.5 /1M input tokens
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Output price

AA · /1M output tokens

Text · Chat / text

$4.5 /1M output tokens26.6%

exact aliasverified runtime

Row details

Raw value: $4.5 /1M output tokens
Percentile: 26.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 mini (xhigh)

Source row

$0.9 /1M output tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $0.9 /1M output tokens
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

GPQA

AA · %

Text · Reasoning / math / science

60.6%44.1%

exact aliasverified runtime

Row details

Raw value: 60.6%
Percentile: 44.1%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 mini (Non-Reasoning)

Source row

87.6%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 87.6%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Humanity's Last Exam

AA · %

Text · Reasoning / math / science

5.1%39.6%

exact aliasverified runtime

Row details

Raw value: 5.1%
Percentile: 39.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5 mini (minimal)

Source row

33.6%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 33.6%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

CritPt

AA · %

Text · Reasoning / math / science

0%60.3%

exact aliasverified runtime

Row details

Raw value: 0%
Percentile: 60.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5 mini (minimal)

Source row

10.9%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 10.9%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

GPT-5.4 mini vs Agnes 2.5 Pro Alpha

GPT-5.4 mini

GPT-5.4 mini leads this compare set for everyday chatbot.

Agnes 2.5 Pro Alpha

GPT-5.4 mini case

Agnes 2.5 Pro Alpha case

What changes the outcome

Why this result is surprising

Why this is not a clean win

Share the recommendation with the source data attached.

Open or copy the stable surfaces

Use the exact public framing

Pick the voice before you post

Compose a post that keeps the warning attached

Decisive benchmarks

Loading model comparison.

GPT-5.4 mini vs Agnes 2.5 Pro Alpha

GPT-5.4 mini

GPT-5.4 mini leads this compare set for everyday chatbot.

Agnes 2.5 Pro Alpha

GPT-5.4 mini case

Agnes 2.5 Pro Alpha case

What changes the outcome

Why this result is surprising

Why this is not a clean win

Share the recommendation with the source data attached.

Open or copy the stable surfaces

Use the exact public framing

Pick the voice before you post

Compose a post that keeps the warning attached

Decisive benchmarks