Benchmarks · /benchmarks/vals-ai-vals_index

Vals Index

Name: Vals Index
Creator: Vals AI

Vals combined benchmark across finance and coding tasks.

Source · Vals AI
Version · vals-ai snapshot 2026-06-24
Scores · 27

Test details

Verified but agingThis is a combined signal, so it bundles multiple inputs and should not be treated as one clean test.

source

Vals AI

metric

Accuracy (%)

judge

Combined

direction

higher better

group id

vals_index_current

domain

Professional reasoning

What it measures vs what it misses

✓ Measures

Weighted model performance across economically relevant Vals tasks.

✗ Misses

Open-ended chat preference, latency, and cost.

Why this countsWeighted model performance across economically relevant Vals tasks.Same-test ruleThis percentile only compares models inside the exact benchmark/version group shown here. It is not a universal score.What it missesOpen-ended chat preference, latency, and cost.

Leaderboard · this benchmark version

#1 · Claude Fable 5

VALS-AI · Jun 17, 2026

Source label: anthropic/claude-fable-5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 100%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Anthropic.

7574 - 76

#2 · Claude Opus 4.8

VALS-AI · Jun 17, 2026

Source label: anthropic/claude-opus-4-8

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 96.2%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Anthropic.

7069 - 72

#3 · GPT-5.5

VALS-AI · Jun 17, 2026

Source label: openai/gpt-5.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 92.3%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: OpenAI.

6865 - 71

#4 · Claude Opus 4.7

VALS-AI · Jun 17, 2026

Source label: anthropic/claude-opus-4-7

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 88.5%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Anthropic.

6664 - 69

#5 · glm-5.2-max

VALS-AI · Jun 17, 2026

Source label: zai/glm-5.2

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 84.6%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Zhipu AI.

6562 - 68

#6 · Gemini 3.5 Flash

VALS-AI · Jun 17, 2026

Source label: google/gemini-3.5-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 80.8%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Google.

6360 - 66

#7 · Claude Sonnet 4.6

VALS-AI · Jun 17, 2026

Source label: anthropic/claude-sonnet-4-6

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 76.9%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Anthropic.

6057 - 63

#8 · minimax-m3

VALS-AI · Jun 17, 2026

Source label: minimax/MiniMax-M3

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 73.1%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: MiniMax.

5955 - 63

#9 · Qwen3.7 Max

VALS-AI · Jun 17, 2026

Source label: alibaba/qwen3.7-max

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 69.2%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Alibaba.

5754 - 61

#10 · deepseek-v4-pro

VALS-AI · Jun 17, 2026

Source label: deepseek/deepseek-v4-pro

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 65.4%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: DeepSeek.

5652 - 59

#11 · kimi-k2.6

VALS-AI · Jun 17, 2026

Source label: kimi/kimi-k2.6

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 61.5%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Moonshot AI.

5551 - 59

#12 · Gemini 3.1 Pro Preview

VALS-AI · Jun 17, 2026

Source label: google/gemini-3.1-pro-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 57.7%
Last updated: aging
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Google.

5451 - 57

#13 · glm-5.1

VALS-AI · Jun 17, 2026

Source label: zai/glm-5.1

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 53.8%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Zhipu AI.

5249 - 56

#14 · GPT-5.4 mini

VALS-AI · Jun 17, 2026

Source label: openai/gpt-5.4-mini-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 50%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: OpenAI.

5248 - 56

#15 · qwen3.7-plus

VALS-AI · Jun 17, 2026

Source label: alibaba/qwen3.7-plus

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 46.2%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Alibaba.

5249 - 56

#16 · mimo-v2.5

VALS-AI · Jun 17, 2026

Source label: xiaomi/mimo-v2.5

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 42.3%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Xiaomi.

5248 - 55

#17 · mimo-v2.5-pro

VALS-AI · Jun 17, 2026

Source label: xiaomi/mimo-v2.5-pro

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 38.5%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Xiaomi.

5148 - 54

#18 · Gemini 3 Flash

VALS-AI · Jun 17, 2026

Source label: google/gemini-3-flash-preview

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 34.6%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Google.

5047 - 53

#19 · qwen3.6-plus

VALS-AI · Jun 17, 2026

Source label: alibaba/qwen3.6-plus

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 30.8%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Alibaba.

4946 - 52

#20 · GPT-5.4 nano

VALS-AI · Jun 17, 2026

Source label: openai/gpt-5.4-nano-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 26.9%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: OpenAI.

4743 - 50

#21 · Grok 4.3

VALS-AI · Jun 17, 2026

Source label: grok/grok-4.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 23.1%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: xAI.

4644 - 49

#22 · Nemotron 3 Ultra 550B A55B (Reasoning)

VALS-AI · Jun 17, 2026

Source label: nvidia/nemotron-3-ultra-550b-a55b

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 19.2%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Nvidia.

4442 - 46

#23 · minimax-m2.7

VALS-AI · Jun 17, 2026

Source label: minimax/MiniMax-M2.7

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 15.4%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: MiniMax.

4239 - 44

#24 · Claude Haiku 4.5

VALS-AI · Jun 17, 2026

Source label: anthropic/claude-haiku-4-5-20251001-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 11.5%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Anthropic.

4139 - 43

#25 · Grok 4.20

VALS-AI · Jun 17, 2026

Source label: grok/grok-4.20-0309-reasoning

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 7.7%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: xAI.

3938 - 41

#26 · mistral-medium-3.5

VALS-AI · Jun 17, 2026

Source label: mistralai/mistral-medium-3.5

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 3.8%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Mistral AI.

3836 - 40

#27 · Gemini 3.1 Flash-Lite Preview

VALS-AI · Jun 17, 2026

Source label: google/gemini-3.1-flash-lite-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 0%
Last updated: aging
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Google.

3635 - 38

Benchmarks · /benchmarks/vals-ai-vals_index

Vals Index

Vals combined benchmark across finance and coding tasks.

Source · Vals AI
Version · vals-ai snapshot 2026-06-24
Scores · 27

Test details

Verified but agingThis is a combined signal, so it bundles multiple inputs and should not be treated as one clean test.

source

Vals AI

metric

Accuracy (%)

judge

Combined

direction

higher better

group id

vals_index_current

domain

Professional reasoning

What it measures vs what it misses

✓ Measures

Weighted model performance across economically relevant Vals tasks.

✗ Misses

Open-ended chat preference, latency, and cost.

Leaderboard · this benchmark version

#1 · Claude Fable 5

VALS-AI · Jun 17, 2026

Source label: anthropic/claude-fable-5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 100%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Anthropic.

7574 - 76

#2 · Claude Opus 4.8

VALS-AI · Jun 17, 2026

Source label: anthropic/claude-opus-4-8

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 96.2%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Anthropic.

7069 - 72

#3 · GPT-5.5

VALS-AI · Jun 17, 2026

Source label: openai/gpt-5.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 92.3%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: OpenAI.

6865 - 71

#4 · Claude Opus 4.7

VALS-AI · Jun 17, 2026

Source label: anthropic/claude-opus-4-7

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 88.5%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Anthropic.

6664 - 69

#5 · glm-5.2-max

VALS-AI · Jun 17, 2026

Source label: zai/glm-5.2

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 84.6%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Zhipu AI.

6562 - 68

#6 · Gemini 3.5 Flash

VALS-AI · Jun 17, 2026

Source label: google/gemini-3.5-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 80.8%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Google.

6360 - 66

#7 · Claude Sonnet 4.6

VALS-AI · Jun 17, 2026

Source label: anthropic/claude-sonnet-4-6

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 76.9%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Anthropic.

6057 - 63

#8 · minimax-m3

VALS-AI · Jun 17, 2026

Source label: minimax/MiniMax-M3

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 73.1%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: MiniMax.

5955 - 63

#9 · Qwen3.7 Max

VALS-AI · Jun 17, 2026

Source label: alibaba/qwen3.7-max

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 69.2%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Alibaba.

5754 - 61

#10 · deepseek-v4-pro

VALS-AI · Jun 17, 2026

Source label: deepseek/deepseek-v4-pro

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 65.4%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: DeepSeek.

5652 - 59

#11 · kimi-k2.6

VALS-AI · Jun 17, 2026

Source label: kimi/kimi-k2.6

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 61.5%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Moonshot AI.

5551 - 59

#12 · Gemini 3.1 Pro Preview

VALS-AI · Jun 17, 2026

Source label: google/gemini-3.1-pro-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 57.7%
Last updated: aging
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Google.

5451 - 57

#13 · glm-5.1

VALS-AI · Jun 17, 2026

Source label: zai/glm-5.1

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 53.8%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Zhipu AI.

5249 - 56

#14 · GPT-5.4 mini

VALS-AI · Jun 17, 2026

Source label: openai/gpt-5.4-mini-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 50%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: OpenAI.

5248 - 56

#15 · qwen3.7-plus

VALS-AI · Jun 17, 2026

Source label: alibaba/qwen3.7-plus

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 46.2%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Alibaba.

5249 - 56

#16 · mimo-v2.5

VALS-AI · Jun 17, 2026

Source label: xiaomi/mimo-v2.5

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 42.3%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Xiaomi.

5248 - 55

#17 · mimo-v2.5-pro

VALS-AI · Jun 17, 2026

Source label: xiaomi/mimo-v2.5-pro

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 38.5%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Xiaomi.

5148 - 54

#18 · Gemini 3 Flash

VALS-AI · Jun 17, 2026

Source label: google/gemini-3-flash-preview

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 34.6%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Google.

5047 - 53

#19 · qwen3.6-plus

VALS-AI · Jun 17, 2026

Source label: alibaba/qwen3.6-plus

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 30.8%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Alibaba.

4946 - 52

#20 · GPT-5.4 nano

VALS-AI · Jun 17, 2026

Source label: openai/gpt-5.4-nano-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 26.9%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: OpenAI.

4743 - 50

#21 · Grok 4.3

VALS-AI · Jun 17, 2026

Source label: grok/grok-4.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 23.1%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: xAI.

4644 - 49

#22 · Nemotron 3 Ultra 550B A55B (Reasoning)

VALS-AI · Jun 17, 2026

Source label: nvidia/nemotron-3-ultra-550b-a55b

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 19.2%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Nvidia.

4442 - 46

#23 · minimax-m2.7

VALS-AI · Jun 17, 2026

Source label: minimax/MiniMax-M2.7

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 15.4%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: MiniMax.

4239 - 44

#24 · Claude Haiku 4.5

VALS-AI · Jun 17, 2026

Source label: anthropic/claude-haiku-4-5-20251001-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 11.5%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Anthropic.

4139 - 43

#25 · Grok 4.20

VALS-AI · Jun 17, 2026

Source label: grok/grok-4.20-0309-reasoning

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 7.7%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: xAI.

3938 - 41

#26 · mistral-medium-3.5

VALS-AI · Jun 17, 2026

Source label: mistralai/mistral-medium-3.5

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 3.8%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Mistral AI.

3836 - 40

#27 · Gemini 3.1 Flash-Lite Preview

VALS-AI · Jun 17, 2026

Source label: google/gemini-3.1-flash-lite-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_index
Percentile: 0%
Last updated: aging
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: Google.

3635 - 38

Vals Index

Test details

What it measures vs what it misses

✓ Measures

✗ Misses

Leaderboard · this benchmark version

Loading benchmark evidence.

Vals Index

Test details

What it measures vs what it misses

✓ Measures

✗ Misses

Leaderboard · this benchmark version