Model vs model

Grok 4.1 Fast vs Agnes 2.5 Pro Alpha

A debate-ready pair page: current winner, strongest alternative, decisive benchmarks, and the warning that should travel with the claim.

Use case · Everyday chatbot
Winner · Grok 4.1 Fast
Sources · All public sources

Winner

Grok 4.1 Fast

xAI

8benchmarks won

Chat / text

Versus · Everyday chatbot

Grok 4.1 Fast leads this compare set for everyday chatbot.

Grok 4.1 Fast8 of 8 wins

Verified and stable

0 shared benchmarks are still too close to call, so the win stays conditional. This compare uses all public sources, with provider-official evidence labeled separately.

Close calls: 0
Sources: All public

Full compare workspace Disagreement page

100%win share

Challenger

Agnes 2.5 Pro Alpha

Unknown

0benchmarks won

Reasoning / math / science

The cases in full

Grok 4.1 Fast case

Chat / text

Agnes 2.5 Pro Alpha case

Reasoning / math / science

What changes the outcome

Grok 4.1 Fast: 102 visible benchmark gaps still leave room for the result to move.
Agnes 2.5 Pro Alpha: 121 visible benchmark gaps still leave room for the result to move.

Why this result is surprising

The visible shared evidence is more decisive than usual for this compare set.
Very few shared benchmarks are decisively separating these models.

Why this is not a clean win

0 shared benchmarks are still too close to call, so the win stays conditional. This compare uses all public sources, with provider-official evidence labeled separately.
Agnes 2.5 Pro Alpha remains the strongest alternative once you change use case, mode, or missing-evidence assumptions.

Open full compare workspace Open evidence page Open disagreement page

Decisive benchmarks

8 of 138 benchmarks


Intelligence Index AA · index Text · Chat / text	1758.8% exact aliasverified runtime Row details Raw value 17 Percentile 58.8% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label Grok 4.1 Fast (Non-reasoning) Source row	40n/a exact aliasverified runtimeContext only Row details Raw value 40 Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
GPQA AA · % Text · Reasoning / math / science	63.7%48.3% exact aliasverified runtime Row details Raw value 63.7% Percentile 48.3% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label Grok 4.1 Fast (Non-reasoning) Source row	87.6%n/a exact aliasverified runtimeContext only Row details Raw value 87.6% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Humanity's Last Exam AA · % Text · Reasoning / math / science	5.1%40.3% exact aliasverified runtime Row details Raw value 5.1% Percentile 40.3% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label Grok 4.1 Fast (Non-reasoning) Source row	33.6%n/a exact aliasverified runtimeContext only Row details Raw value 33.6% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
CritPt AA · % Text · Reasoning / math / science	0%60.3% exact aliasverified runtime Row details Raw value 0% Percentile 60.3% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label Grok 4.1 Fast (Non-reasoning) Source row	10.9%n/a exact aliasverified runtimeContext only Row details Raw value 10.9% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
SciCode AA · % Code · Coding	29.6%48.6% exact aliasverified runtime Row details Raw value 29.6% Percentile 48.6% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label Grok 4.1 Fast (Non-reasoning) Source row	42.2%n/a exact aliasverified runtimeContext only Row details Raw value 42.2% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
AA-Omniscience accuracy AA · % Text · Chat / text	17.2%43.7% exact aliasverified runtime Row details Raw value 17.2% Percentile 43.7% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label Grok 4.1 Fast (Non-reasoning) Source row	33.5%n/a exact aliasverified runtimeContext only Row details Raw value 33.5% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
AA-Omniscience non-hallucination AA · % Text · Chat / text	17.7%53.6% exact aliasverified runtime Row details Raw value 17.7% Percentile 53.6% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label Grok 4.1 Fast (Non-reasoning) Source row	11.9%n/a exact aliasverified runtimeContext only Row details Raw value 11.9% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a
Long Context Reasoning AA · % Document · Long context	28.7%44.3% exact aliasverified runtime Row details Raw value 28.7% Percentile 44.3% Last updated recent Eligibility headline eligible Identity provider alias (0.94) Source label Grok 4.1 Fast (Non-reasoning) Source row	73%n/a exact aliasverified runtimeContext only Row details Raw value 73% Percentile n/a Last updated recent Eligibility preview_model Identity provider alias (0.94) Source label Agnes 2.5 Pro Alpha Source row	n/a

1-8 of 8

Page 1 of 1Page size

Intelligence Index

AA · index

Text · Chat / text

1758.8%

exact aliasverified runtime

Row details

Raw value: 17
Percentile: 58.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: Grok 4.1 Fast (Non-reasoning)

Source row

40n/a

exact aliasverified runtimeContext only

Row details

Raw value: 40
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

GPQA

AA · %

Text · Reasoning / math / science

63.7%48.3%

exact aliasverified runtime

Row details

Raw value: 63.7%
Percentile: 48.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: Grok 4.1 Fast (Non-reasoning)

Source row

87.6%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 87.6%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Humanity's Last Exam

AA · %

Text · Reasoning / math / science

5.1%40.3%

exact aliasverified runtime

Row details

Raw value: 5.1%
Percentile: 40.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: Grok 4.1 Fast (Non-reasoning)

Source row

33.6%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 33.6%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

CritPt

AA · %

Text · Reasoning / math / science

0%60.3%

exact aliasverified runtime

Row details

Raw value: 0%
Percentile: 60.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: Grok 4.1 Fast (Non-reasoning)

Source row

10.9%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 10.9%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

SciCode

AA · %

Code · Coding

29.6%48.6%

exact aliasverified runtime

Row details

Raw value: 29.6%
Percentile: 48.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: Grok 4.1 Fast (Non-reasoning)

Source row

42.2%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 42.2%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

AA-Omniscience accuracy

AA · %

Text · Chat / text

17.2%43.7%

exact aliasverified runtime

Row details

Raw value: 17.2%
Percentile: 43.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: Grok 4.1 Fast (Non-reasoning)

Source row

33.5%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 33.5%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

AA-Omniscience non-hallucination

AA · %

Text · Chat / text

17.7%53.6%

exact aliasverified runtime

Row details

Raw value: 17.7%
Percentile: 53.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: Grok 4.1 Fast (Non-reasoning)

Source row

11.9%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 11.9%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Long Context Reasoning

AA · %

Document · Long context

28.7%44.3%

exact aliasverified runtime

Row details

Raw value: 28.7%
Percentile: 44.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.94)
Source label: Grok 4.1 Fast (Non-reasoning)

Source row

73%n/a

exact aliasverified runtimeContext only

Row details

Raw value: 73%
Percentile: n/a
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.94)
Source label: Agnes 2.5 Pro Alpha

Source row

n/a

Grok 4.1 Fast vs Agnes 2.5 Pro Alpha

Grok 4.1 Fast

Grok 4.1 Fast leads this compare set for everyday chatbot.

Agnes 2.5 Pro Alpha

Grok 4.1 Fast case

Agnes 2.5 Pro Alpha case

What changes the outcome

Why this result is surprising

Why this is not a clean win

Share the recommendation with the source data attached.

Open or copy the stable surfaces

Use the exact public framing

Pick the voice before you post

Compose a post that keeps the warning attached

Decisive benchmarks

Loading model comparison.

Grok 4.1 Fast vs Agnes 2.5 Pro Alpha

Grok 4.1 Fast

Grok 4.1 Fast leads this compare set for everyday chatbot.

Agnes 2.5 Pro Alpha

Grok 4.1 Fast case

Agnes 2.5 Pro Alpha case

What changes the outcome

Why this result is surprising

Why this is not a clean win

Share the recommendation with the source data attached.

Open or copy the stable surfaces

Use the exact public framing

Pick the voice before you post

Compose a post that keeps the warning attached

Decisive benchmarks