Model vs model

GPT-5.4 vs Agnes 2.5 Pro Alpha

A debate-ready pair page: current winner, strongest alternative, decisive benchmarks, and the warning that should travel with the claim.

Use case · Everyday chatbot
Winner · GPT-5.4
Sources · All public sources

Winner

GPT-5.4

OpenAI

17benchmarks won

Professional reasoning
Chat / text

Versus · Everyday chatbot

GPT-5.4 leads this compare set for everyday chatbot.

GPT-5.417 of 17 wins

Verified but aging

0 shared benchmarks are still too close to call, so the win stays conditional. This compare uses all public sources, with provider-official evidence labeled separately.

Close calls: 0
Sources: All public

Full compare workspace Disagreement page

100%win share

Challenger

Agnes 2.5 Pro Alpha

Unknown

0benchmarks won

Reasoning / math / science

The cases in full

GPT-5.4 case

Professional reasoning
Chat / text

Agnes 2.5 Pro Alpha case

Reasoning / math / science

What changes the outcome

GPT-5.4: 30 visible benchmark gaps still leave room for the result to move.
Agnes 2.5 Pro Alpha: 121 visible benchmark gaps still leave room for the result to move.

Why this result is surprising

The visible shared evidence is more decisive than usual for this compare set.
Very few shared benchmarks are decisively separating these models.

Why this is not a clean win

0 shared benchmarks are still too close to call, so the win stays conditional. This compare uses all public sources, with provider-official evidence labeled separately.
Agnes 2.5 Pro Alpha remains the strongest alternative once you change use case, mode, or missing-evidence assumptions.

Open full compare workspace Open evidence page Open disagreement page

Decisive benchmarks

17 of 138 benchmarks


Intelligence Index AA · index Text · Chat / text	2877.6% exact aliasverified runtime Row details Raw value 28 Percentile 77.6% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (Non-reasoning) Source row	40n/a exact aliasverified runtimeContext only Row details Raw value 40 Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Time to first token AA · s Text · Chat / text	144.08s2.7% exact aliasverified runtime Row details Raw value 144.08s Percentile 2.7% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (xhigh) Source row	2.09sn/a exact aliasverified runtimeContext only Row details Raw value 2.09s Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Coding Index AA · index Code · Coding	7189.9% exact aliasverified runtime Row details Raw value 71 Percentile 89.9% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (xhigh) Source row	59n/a exact aliasverified runtimeContext only Row details Raw value 59 Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Agentic Index AA · index Code · Coding	4486.5% exact aliasverified runtime Row details Raw value 44 Percentile 86.5% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (xhigh) Source row	25n/a exact aliasverified runtimeContext only Row details Raw value 25 Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Output Speed AA · tokens/s Text · Chat / text	90.2 tokens/s51.3% exact aliasverified runtime Row details Raw value 90.2 tokens/s Percentile 51.3% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (Non-reasoning) Source row	132 tokens/sn/a exact aliasverified runtimeContext only Row details Raw value 132 tokens/s Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Time to first answer token AA · s Text · Chat / text	144.08s2.7% exact aliasverified runtime Row details Raw value 144.08s Percentile 2.7% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (xhigh) Source row	17.24sn/a exact aliasverified runtimeContext only Row details Raw value 17.24s Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Blended price AA · /1M tokens Text · Chat / text	$5.6 /1M tokens12.6% exact aliasverified runtime Row details Raw value $5.6 /1M tokens Percentile 12.6% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (xhigh) Source row	$0.6 /1M tokensn/a exact aliasverified runtimeContext only Row details Raw value $0.6 /1M tokens Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Input price AA · /1M input tokens Text · Chat / text	$2.5 /1M input tokens13.6% exact aliasverified runtime Row details Raw value $2.5 /1M input tokens Percentile 13.6% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (xhigh) Source row	$0.5 /1M input tokensn/a exact aliasverified runtimeContext only Row details Raw value $0.5 /1M input tokens Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Output price AA · /1M output tokens Text · Chat / text	$15 /1M output tokens12.3% exact aliasverified runtime Row details Raw value $15 /1M output tokens Percentile 12.3% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (xhigh) Source row	$0.9 /1M output tokensn/a exact aliasverified runtimeContext only Row details Raw value $0.9 /1M output tokens Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
GPQA AA · % Text · Reasoning / math / science	74.8%67.4% exact aliasverified runtime Row details Raw value 74.8% Percentile 67.4% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (Non-reasoning) Source row	87.6%n/a exact aliasverified runtimeContext only Row details Raw value 87.6% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Humanity's Last Exam AA · % Text · Reasoning / math / science	11.3%70.4% exact aliasverified runtime Row details Raw value 11.3% Percentile 70.4% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (Non-reasoning) Source row	33.6%n/a exact aliasverified runtimeContext only Row details Raw value 33.6% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
CritPt AA · % Text · Reasoning / math / science	0.6%74.1% exact aliasverified runtime Row details Raw value 0.6% Percentile 74.1% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label GPT-5.4 (Non-reasoning) Source row	10.9%n/a exact aliasverified runtimeContext only Row details Raw value 10.9% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a

1-12 of 17

Page 1 of 2Page size

Intelligence Index

AA · index

Text · Chat / text

2877.6%

exact aliasverified runtime

Row details

Raw value: 28
Percentile: 77.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (Non-reasoning)

Source row

40n/a

exact aliasverified runtimeContext only

Row details

Raw value: 40
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Time to first token

AA · s

Text · Chat / text

144.08s2.7%

exact aliasverified runtime

Row details

Raw value: 144.08s
Percentile: 2.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (xhigh)

Source row

2.09sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 2.09s
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Coding Index

AA · index

Code · Coding

7189.9%

exact aliasverified runtime

Row details

Raw value: 71
Percentile: 89.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (xhigh)

Source row

59n/a

exact aliasverified runtimeContext only

Row details

Raw value: 59
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Agentic Index

AA · index

Code · Coding

4486.5%

exact aliasverified runtime

Row details

Raw value: 44
Percentile: 86.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (xhigh)

Source row

25n/a

exact aliasverified runtimeContext only

Row details

Raw value: 25
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Output Speed

AA · tokens/s

Text · Chat / text

90.2 tokens/s51.3%

exact aliasverified runtime

Row details

Raw value: 90.2 tokens/s
Percentile: 51.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (Non-reasoning)

Source row

132 tokens/sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 132 tokens/s
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Time to first answer token

AA · s

Text · Chat / text

144.08s2.7%

exact aliasverified runtime

Row details

Raw value: 144.08s
Percentile: 2.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (xhigh)

Source row

17.24sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 17.24s
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Blended price

AA · /1M tokens

Text · Chat / text

$5.6 /1M tokens12.6%

exact aliasverified runtime

Row details

Raw value: $5.6 /1M tokens
Percentile: 12.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (xhigh)

Source row

$0.6 /1M tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $0.6 /1M tokens
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Input price

AA · /1M input tokens

Text · Chat / text

$2.5 /1M input tokens13.6%

exact aliasverified runtime

Row details

Raw value: $2.5 /1M input tokens
Percentile: 13.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (xhigh)

Source row

$0.5 /1M input tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $0.5 /1M input tokens
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Output price

AA · /1M output tokens

Text · Chat / text

$15 /1M output tokens12.3%

exact aliasverified runtime

Row details

Raw value: $15 /1M output tokens
Percentile: 12.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (xhigh)

Source row

$0.9 /1M output tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $0.9 /1M output tokens
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

GPQA

AA · %

Text · Reasoning / math / science

74.8%67.4%

exact aliasverified runtime

Row details

Raw value: 74.8%
Percentile: 67.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (Non-reasoning)

Source row

87.6%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 87.6%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Humanity's Last Exam

AA · %

Text · Reasoning / math / science

11.3%70.4%

exact aliasverified runtime

Row details

Raw value: 11.3%
Percentile: 70.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (Non-reasoning)

Source row

33.6%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 33.6%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

CritPt

AA · %

Text · Reasoning / math / science

0.6%74.1%

exact aliasverified runtime

Row details

Raw value: 0.6%
Percentile: 74.1%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: GPT-5.4 (Non-reasoning)

Source row

10.9%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 10.9%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

GPT-5.4 vs Agnes 2.5 Pro Alpha

GPT-5.4

GPT-5.4 leads this compare set for everyday chatbot.

Agnes 2.5 Pro Alpha

GPT-5.4 case

Agnes 2.5 Pro Alpha case

What changes the outcome

Why this result is surprising

Why this is not a clean win

Share the recommendation with the source data attached.

Open or copy the stable surfaces

Use the exact public framing

Pick the voice before you post

Compose a post that keeps the warning attached

Decisive benchmarks

Loading model comparison.

GPT-5.4 vs Agnes 2.5 Pro Alpha

GPT-5.4

GPT-5.4 leads this compare set for everyday chatbot.

Agnes 2.5 Pro Alpha

GPT-5.4 case

Agnes 2.5 Pro Alpha case

What changes the outcome

Why this result is surprising

Why this is not a clean win

Share the recommendation with the source data attached.

Open or copy the stable surfaces

Use the exact public framing

Pick the voice before you post

Compose a post that keeps the warning attached

Decisive benchmarks