Benchmarks · /benchmarks/vals-ai-vals_multimodal_index

Vals Multimodal Index

Name: Vals Multimodal Index
Creator: Vals AI

Vals combined benchmark across finance, coding, and education tasks.

Source · Vals AI
Version · vals-ai snapshot 2026-06-24
Scores · 20

Test details

Verified but agingThis is a combined signal, so it bundles multiple inputs and should not be treated as one clean test.

source

Vals AI

metric

Accuracy (%)

judge

Combined

direction

higher better

group id

vals_multimodal_index_current

domain

Document understanding

What it measures vs what it misses

✓ Measures

Weighted model performance across multimodal professional Vals tasks.

✗ Misses

Pure text chat preference, media generation, latency, and cost.

Why this countsIt matters when the job is reading PDFs, tables, forms, or mixed-layout documents rather than plain chat.Same-test ruleThis percentile only compares models inside the exact benchmark/version group shown here. It is not a universal score.What it missesIt does not stand in for end-to-end document workflow quality or search relevance.

Leaderboard · this benchmark version

#1 · Claude Fable 5

VALS-AI · Jun 10, 2026

Source label: anthropic/claude-fable-5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 100%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Anthropic.

7473 - 75

#2 · Claude Opus 4.8

VALS-AI · Jun 10, 2026

Source label: anthropic/claude-opus-4-8

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 94.7%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Anthropic.

7169 - 72

#3 · GPT-5.5

VALS-AI · Jun 10, 2026

Source label: openai/gpt-5.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 89.5%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: OpenAI.

6865 - 71

#4 · Claude Opus 4.7

VALS-AI · Jun 10, 2026

Source label: anthropic/claude-opus-4-7

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 84.2%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Anthropic.

6765 - 70

#5 · Gemini 3.5 Flash

VALS-AI · Jun 10, 2026

Source label: google/gemini-3.5-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 78.9%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Google.

6360 - 66

#6 · Claude Sonnet 4.6

VALS-AI · Jun 10, 2026

Source label: anthropic/claude-sonnet-4-6

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 73.7%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Anthropic.

6158 - 63

#7 · minimax-m3

VALS-AI · Jun 10, 2026

Source label: minimax/MiniMax-M3

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 68.4%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: MiniMax.

6057 - 63

#8 · kimi-k2.6

VALS-AI · Jun 10, 2026

Source label: kimi/kimi-k2.6

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 63.2%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Moonshot AI.

5653 - 60

#9 · Gemini 3.1 Pro Preview

VALS-AI · Jun 10, 2026

Source label: google/gemini-3.1-pro-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 57.9%
Last updated: aging
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Google.

5653 - 59

#10 · GPT-5.4 mini

VALS-AI · Jun 10, 2026

Source label: openai/gpt-5.4-mini-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 52.6%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: OpenAI.

5451 - 58

#11 · qwen3.7-plus

VALS-AI · Jun 10, 2026

Source label: alibaba/qwen3.7-plus

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 47.4%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Alibaba.

5451 - 57

#12 · mimo-v2.5

VALS-AI · Jun 10, 2026

Source label: xiaomi/mimo-v2.5

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 42.1%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Xiaomi.

5350 - 56

#13 · Gemini 3 Flash

VALS-AI · Jun 10, 2026

Source label: google/gemini-3-flash-preview

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 36.8%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Google.

5249 - 55

#14 · qwen3.6-plus

VALS-AI · Jun 10, 2026

Source label: alibaba/qwen3.6-plus

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 31.6%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Alibaba.

5249 - 54

#15 · GPT-5.4 nano

VALS-AI · Jun 10, 2026

Source label: openai/gpt-5.4-nano-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 26.3%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: OpenAI.

4844 - 51

#16 · Grok 4.3

VALS-AI · Jun 10, 2026

Source label: grok/grok-4.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 21.1%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: xAI.

4341 - 46

#17 · Claude Haiku 4.5

VALS-AI · Jun 10, 2026

Source label: anthropic/claude-haiku-4-5-20251001-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 15.8%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Anthropic.

4341 - 45

#18 · Gemini 3.1 Flash-Lite Preview

VALS-AI · Jun 10, 2026

Source label: google/gemini-3.1-flash-lite-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 10.5%
Last updated: aging
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Google.

4140 - 43

#19 · Grok 4.20

VALS-AI · Jun 10, 2026

Source label: grok/grok-4.20-0309-reasoning

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 5.3%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: xAI.

3938 - 40

#20 · mistral-medium-3.5

VALS-AI · Jun 10, 2026

Source label: mistralai/mistral-medium-3.5

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 0%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Mistral AI.

3533 - 36

Benchmarks · /benchmarks/vals-ai-vals_multimodal_index

Vals Multimodal Index

Vals combined benchmark across finance, coding, and education tasks.

Source · Vals AI
Version · vals-ai snapshot 2026-06-24
Scores · 20

Test details

Verified but agingThis is a combined signal, so it bundles multiple inputs and should not be treated as one clean test.

source

Vals AI

metric

Accuracy (%)

judge

Combined

direction

higher better

group id

vals_multimodal_index_current

domain

Document understanding

What it measures vs what it misses

✓ Measures

Weighted model performance across multimodal professional Vals tasks.

✗ Misses

Pure text chat preference, media generation, latency, and cost.

Leaderboard · this benchmark version

#1 · Claude Fable 5

VALS-AI · Jun 10, 2026

Source label: anthropic/claude-fable-5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 100%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Anthropic.

7473 - 75

#2 · Claude Opus 4.8

VALS-AI · Jun 10, 2026

Source label: anthropic/claude-opus-4-8

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 94.7%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Anthropic.

7169 - 72

#3 · GPT-5.5

VALS-AI · Jun 10, 2026

Source label: openai/gpt-5.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 89.5%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: OpenAI.

6865 - 71

#4 · Claude Opus 4.7

VALS-AI · Jun 10, 2026

Source label: anthropic/claude-opus-4-7

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 84.2%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Anthropic.

6765 - 70

#5 · Gemini 3.5 Flash

VALS-AI · Jun 10, 2026

Source label: google/gemini-3.5-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 78.9%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Google.

6360 - 66

#6 · Claude Sonnet 4.6

VALS-AI · Jun 10, 2026

Source label: anthropic/claude-sonnet-4-6

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 73.7%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Anthropic.

6158 - 63

#7 · minimax-m3

VALS-AI · Jun 10, 2026

Source label: minimax/MiniMax-M3

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 68.4%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: MiniMax.

6057 - 63

#8 · kimi-k2.6

VALS-AI · Jun 10, 2026

Source label: kimi/kimi-k2.6

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 63.2%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Moonshot AI.

5653 - 60

#9 · Gemini 3.1 Pro Preview

VALS-AI · Jun 10, 2026

Source label: google/gemini-3.1-pro-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 57.9%
Last updated: aging
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Google.

5653 - 59

#10 · GPT-5.4 mini

VALS-AI · Jun 10, 2026

Source label: openai/gpt-5.4-mini-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 52.6%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: OpenAI.

5451 - 58

#11 · qwen3.7-plus

VALS-AI · Jun 10, 2026

Source label: alibaba/qwen3.7-plus

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 47.4%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Alibaba.

5451 - 57

#12 · mimo-v2.5

VALS-AI · Jun 10, 2026

Source label: xiaomi/mimo-v2.5

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 42.1%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Xiaomi.

5350 - 56

#13 · Gemini 3 Flash

VALS-AI · Jun 10, 2026

Source label: google/gemini-3-flash-preview

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 36.8%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Google.

5249 - 55

#14 · qwen3.6-plus

VALS-AI · Jun 10, 2026

Source label: alibaba/qwen3.6-plus

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 31.6%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Alibaba.

5249 - 54

#15 · GPT-5.4 nano

VALS-AI · Jun 10, 2026

Source label: openai/gpt-5.4-nano-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 26.3%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: OpenAI.

4844 - 51

#16 · Grok 4.3

VALS-AI · Jun 10, 2026

Source label: grok/grok-4.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 21.1%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: xAI.

4341 - 46

#17 · Claude Haiku 4.5

VALS-AI · Jun 10, 2026

Source label: anthropic/claude-haiku-4-5-20251001-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 15.8%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Anthropic.

4341 - 45

#18 · Gemini 3.1 Flash-Lite Preview

VALS-AI · Jun 10, 2026

Source label: google/gemini-3.1-flash-lite-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 10.5%
Last updated: aging
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Google.

4140 - 43

#19 · Grok 4.20

VALS-AI · Jun 10, 2026

Source label: grok/grok-4.20-0309-reasoning

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 5.3%
Last updated: aging
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: xAI.

3938 - 40

#20 · mistral-medium-3.5

VALS-AI · Jun 10, 2026

Source label: mistralai/mistral-medium-3.5

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/vals_multimodal_index
Percentile: 0%
Last updated: aging
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_multimodal_index; provider: Mistral AI.

3533 - 36

Vals Multimodal Index

Test details

What it measures vs what it misses

✓ Measures

✗ Misses

Leaderboard · this benchmark version

Loading benchmark evidence.

Vals Multimodal Index

Test details

What it measures vs what it misses

✓ Measures

✗ Misses

Leaderboard · this benchmark version