Model vs model

GPT-4.1 vs Agnes 2.5 Pro Alpha

A debate-ready pair page: current winner, strongest alternative, decisive benchmarks, and the warning that should travel with the claim.

Use case · Everyday chatbot
Winner · GPT-4.1
Sources · All public sources

Winner

GPT-4.1

OpenAI

0benchmarks won

Chat / text

Versus · Everyday chatbot

GPT-4.1 leads this compare set for everyday chatbot.

GPT-4.10 of 0 wins

Thin verified coverage

0 shared benchmarks are still too close to call, so the win stays conditional. This compare uses all public sources, with provider-official evidence labeled separately.

Close calls: 0
Sources: All public

Full compare workspace Disagreement page

0%win share

Challenger

Agnes 2.5 Pro Alpha

Unknown

0benchmarks won

Reasoning / math / science

The cases in full

GPT-4.1 case

Chat / text

Agnes 2.5 Pro Alpha case

Reasoning / math / science

What changes the outcome

GPT-4.1: 109 visible benchmark gaps still leave room for the result to move.
Agnes 2.5 Pro Alpha: 121 visible benchmark gaps still leave room for the result to move.

Why this result is surprising

The visible shared evidence is more decisive than usual for this compare set.
Very few shared benchmarks are decisively separating these models.

Why this is not a clean win

0 shared benchmarks are still too close to call, so the win stays conditional. This compare uses all public sources, with provider-official evidence labeled separately.
Agnes 2.5 Pro Alpha remains the strongest alternative once you change use case, mode, or missing-evidence assumptions.

Open full compare workspace Open evidence page Open disagreement page

Decisive benchmarks

14 of 138 benchmarks


Intelligence Index AA · index Text · Chat / text	20n/a exact aliasverified runtimeContext only Row details Raw value 20 Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	40n/a exact aliasverified runtimeContext only Row details Raw value 40 Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Time to first token AA · s Text · Chat / text	0.87sn/a exact aliasverified runtimeContext only Row details Raw value 0.87s Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	2.09sn/a exact aliasverified runtimeContext only Row details Raw value 2.09s Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Output Speed AA · tokens/s Text · Chat / text	141.8 tokens/sn/a exact aliasverified runtimeContext only Row details Raw value 141.8 tokens/s Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	132 tokens/sn/a exact aliasverified runtimeContext only Row details Raw value 132 tokens/s Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Time to first answer token AA · s Text · Chat / text	0.87sn/a exact aliasverified runtimeContext only Row details Raw value 0.87s Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	17.24sn/a exact aliasverified runtimeContext only Row details Raw value 17.24s Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Blended price AA · /1M tokens Text · Chat / text	$3.5 /1M tokensn/a exact aliasverified runtimeContext only Row details Raw value $3.5 /1M tokens Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	$0.6 /1M tokensn/a exact aliasverified runtimeContext only Row details Raw value $0.6 /1M tokens Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Input price AA · /1M input tokens Text · Chat / text	$2 /1M input tokensn/a exact aliasverified runtimeContext only Row details Raw value $2 /1M input tokens Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	$0.5 /1M input tokensn/a exact aliasverified runtimeContext only Row details Raw value $0.5 /1M input tokens Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Output price AA · /1M output tokens Text · Chat / text	$8 /1M output tokensn/a exact aliasverified runtimeContext only Row details Raw value $8 /1M output tokens Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	$0.9 /1M output tokensn/a exact aliasverified runtimeContext only Row details Raw value $0.9 /1M output tokens Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
GPQA AA · % Text · Reasoning / math / science	66.6%n/a exact aliasverified runtimeContext only Row details Raw value 66.6% Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	87.6%n/a exact aliasverified runtimeContext only Row details Raw value 87.6% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Humanity's Last Exam AA · % Text · Reasoning / math / science	4.2%n/a exact aliasverified runtimeContext only Row details Raw value 4.2% Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	33.6%n/a exact aliasverified runtimeContext only Row details Raw value 33.6% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
CritPt AA · % Text · Reasoning / math / science	0%n/a exact aliasverified runtimeContext only Row details Raw value 0% Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	10.9%n/a exact aliasverified runtimeContext only Row details Raw value 10.9% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
SciCode AA · % Code · Coding	38.1%n/a exact aliasverified runtimeContext only Row details Raw value 38.1% Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	42.2%n/a exact aliasverified runtimeContext only Row details Raw value 42.2% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
AA-Omniscience accuracy AA · % Text · Chat / text	27.8%n/a exact aliasverified runtimeContext only Row details Raw value 27.8% Percentile n/a Last updated recent Eligibility historical_model Identity provider alias (0.94) Source label GPT-4.1 Source row	33.5%n/a exact aliasverified runtimeContext only Row details Raw value 33.5% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a

1-12 of 14

Page 1 of 2Page size

Intelligence Index

AA · index

Text · Chat / text

20n/a

exact aliasverified runtimeContext only

Row details

Raw value: 20
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

40n/a

exact aliasverified runtimeContext only

Row details

Raw value: 40
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Time to first token

AA · s

Text · Chat / text

0.87sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 0.87s
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

2.09sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 2.09s
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Output Speed

AA · tokens/s

Text · Chat / text

141.8 tokens/sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 141.8 tokens/s
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

132 tokens/sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 132 tokens/s
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Time to first answer token

AA · s

Text · Chat / text

0.87sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 0.87s
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

17.24sn/a

exact aliasverified runtimeContext only

Row details

Raw value: 17.24s
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Blended price

AA · /1M tokens

Text · Chat / text

$3.5 /1M tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $3.5 /1M tokens
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

$0.6 /1M tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $0.6 /1M tokens
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Input price

AA · /1M input tokens

Text · Chat / text

$2 /1M input tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $2 /1M input tokens
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

$0.5 /1M input tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $0.5 /1M input tokens
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Output price

AA · /1M output tokens

Text · Chat / text

$8 /1M output tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $8 /1M output tokens
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

$0.9 /1M output tokensn/a

exact aliasverified runtimeContext only

Row details

Raw value: $0.9 /1M output tokens
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

GPQA

AA · %

Text · Reasoning / math / science

66.6%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 66.6%
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

87.6%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 87.6%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Humanity's Last Exam

AA · %

Text · Reasoning / math / science

4.2%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 4.2%
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

33.6%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 33.6%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

CritPt

AA · %

Text · Reasoning / math / science

0%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 0%
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

10.9%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 10.9%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

SciCode

AA · %

Code · Coding

38.1%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 38.1%
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

42.2%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 42.2%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

AA-Omniscience accuracy

AA · %

Text · Chat / text

27.8%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 27.8%
Percentile: n/a
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.94)
Source label: GPT-4.1

Source row

33.5%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 33.5%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

GPT-4.1 vs Agnes 2.5 Pro Alpha

GPT-4.1

GPT-4.1 leads this compare set for everyday chatbot.

Agnes 2.5 Pro Alpha

GPT-4.1 case

Agnes 2.5 Pro Alpha case

What changes the outcome

Why this result is surprising

Why this is not a clean win

Share the recommendation with the source data attached.

Open or copy the stable surfaces

Use the exact public framing

Pick the voice before you post

Compose a post that keeps the warning attached

Decisive benchmarks

Loading model comparison.

GPT-4.1 vs Agnes 2.5 Pro Alpha

GPT-4.1

GPT-4.1 leads this compare set for everyday chatbot.

Agnes 2.5 Pro Alpha

GPT-4.1 case

Agnes 2.5 Pro Alpha case

What changes the outcome

Why this result is surprising

Why this is not a clean win

Share the recommendation with the source data attached.

Open or copy the stable surfaces

Use the exact public framing

Pick the voice before you post

Compose a post that keeps the warning attached

Decisive benchmarks