Benchmarks · /benchmarks/vals-ai-mortgage_tax

MortgageTax

Name: MortgageTax
Creator: Vals AI

MortgageTax result as reported by Vals AI.

Source · Vals AI
Version · vals-ai snapshot 2026-10-03
Scores · 87

Test details

Visible tradeoffsThis is an objective signal, so it is mainly about measurable task performance rather than public taste.

source

Vals AI

metric

Accuracy (%)

judge

Objective

direction

higher better

group id

vals_mortgage_tax_current

domain

Document understanding

What it measures vs what it misses

✓ Measures

Reading and understanding tax certificates as images.

✗ Misses

Adjacent skills outside the benchmark task mix, latency, and cost.

Why this countsIt matters when the job is reading PDFs, tables, forms, or mixed-layout documents rather than plain chat.Same-test ruleThis percentile only compares models inside the exact benchmark/version group shown here. It is not a universal score.What it missesIt does not stand in for end-to-end document workflow quality or search relevance.

Leaderboard · this benchmark version

#1 · Claude Opus 5 (Adaptive Reasoning, Max Effort)

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 100%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

72.1%70.3% - 73.8%

#2 · Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-fable-5-1

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 98.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

70.8%69% - 72.5%

#3 · Claude Opus 4.7

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-7

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 97.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

70.3%68.5% - 72%

#4 · Claude Sonnet 5 (Adaptive Reasoning, Max Effort)

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-sonnet-5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 96.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

70%68.3% - 71.8%

#5 · Claude Opus 4.8

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-8

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 95.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

69.9%68.2% - 71.7%

#6 · Gemini 3.1 Pro Preview

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.1-pro-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 94.2%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

69.4%67.6% - 71.2%

#7 · Gemini 3 Pro Preview

VALS-AI · Sep 1, 2026

Source label: google/gemini-3-pro-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 93%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

69.1%67.3% - 70.9%

#8 · Claude Fable 5

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-fable-5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 91.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

68.9%67.1% - 70.7%

#9 · Gemini 2.5 Pro

VALS-AI · Sep 1, 2026

Source label: google/gemini-2.5-pro

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 90.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

68.9%67.1% - 70.7%

#10 · GPT-5.5

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 89.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

68.8%67% - 70.5%

#11 · Gemini 3 Flash Preview

VALS-AI · Sep 1, 2026

Source label: google/gemini-3-flash-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 88.4%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

68.7%66.9% - 70.5%

#12 · gemini-3.5-flash-lite

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.5-flash-lite

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 87.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

68.7%66.9% - 70.5%

#13 · Claude Sonnet 3.7

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-3-7-sonnet-20250219

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 87.2%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

68.7%65.2% - 72.2%

#14 · Claude Opus 4.5

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-5-20251101

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 87.2%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

68.7%66.9% - 70.5%

#15 · Claude Opus 4.6

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-6-thinking

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 83.7%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

68.5%66.7% - 70.3%

#16 · minimax-m3

VALS-AI · Sep 1, 2026

Source label: minimax/MiniMax-M3

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 82.6%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: MiniMax.

68.4%66.6% - 70.1%

#17 · GPT-5.4

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.4-2026-03-05

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 81.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

68.3%66.5% - 70.1%

#18 · Qwen3.6 27B (Reasoning)

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.6-27b

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 80.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

68.3%66.5% - 70.1%

#19 · Gemini 3.5 Flash

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.5-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 79.1%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

68.1%66.3% - 69.9%

#20 · Gemini 3.1 Flash-Lite Preview

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.1-flash-lite-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 77.9%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

68%66.3% - 69.8%

#21 · qwen3.6-plus

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.6-plus

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 76.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

68%66.2% - 69.7%

#22 · Claude Sonnet 4.6

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-sonnet-4-6

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 75.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

67.7%65.9% - 69.5%

#23 · claude-opus-4-5-20251101-thinking

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-5-20251101-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 74.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

67.7%65.9% - 69.5%

#24 · gemini-3.6-flash-high

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.6-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 73.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

67.6%65.8% - 69.4%

#25 · Qwen3.5 Flash

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.5-flash

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 72.1%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

67.4%65.6% - 69.2%

#26 · GPT-5.6 Terra

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.6-terra

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 70.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

67.3%65.5% - 69.1%

#27 · GPT-5.6 Luna

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.6-luna

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 69.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

67.3%65.5% - 69.1%

#28 · GPT-5.6 Sol

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.6-sol

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 68.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

67.3%65.5% - 69.1%

#29 · gpt-5.2-2025-12-11

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.2-2025-12-11

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 67.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

67.1%65.3% - 68.9%

#30 · gpt-5-mini-2025-08-07

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5-mini-2025-08-07

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 66.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

66.9%65.1% - 68.7%

#31 · gemini-3.7-flash-high

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.7-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 65.1%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

66.7%64.8% - 68.5%

#32 · kimi-k2.5-thinking

VALS-AI · Sep 1, 2026

Source label: kimi/kimi-k2.5-thinking

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 64%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Moonshot AI.

66.5%64.7% - 68.3%

#33 · kimi-k3-max

VALS-AI · Sep 1, 2026

Source label: kimi/kimi-k3

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 62.8%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Moonshot AI.

66.3%64.6% - 68.1%

#34 · qwen3.7-plus

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.7-plus

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 61.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

66.2%64.4% - 68%

#35 · muse-spark-1.1

VALS-AI · Sep 1, 2026

Source label: meta/muse_spark_1_1

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 60.5%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Meta.

66.1%64.3% - 68%

#36 · GPT-4.1

VALS-AI · Sep 1, 2026

Source label: openai/gpt-4.1-2025-04-14

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 59.3%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

65.9%64.1% - 67.7%

#37 · kimi-k2.6

VALS-AI · Sep 1, 2026

Source label: kimi/kimi-k2.6

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 58.1%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Moonshot AI.

65.8%64% - 67.6%

#38 · o3

VALS-AI · Sep 1, 2026

Source label: openai/o3-2025-04-16

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 57%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

65.7%63.9% - 67.5%

#39 · GPT-4.1 mini

VALS-AI · Sep 1, 2026

Source label: openai/gpt-4.1-mini-2025-04-14

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 55.8%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

65.5%63.7% - 67.3%

#40 · GPT-5

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5-2025-08-07

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 54.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

65.5%63.7% - 67.2%

#41 · muse-spark-1.2 (xHigh)

VALS-AI · Sep 1, 2026

Source label: meta/muse_spark_1_2

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 53.5%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Meta.

65.4%63.6% - 67.3%

#42 · gemini-3.8-flash-high

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.8-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 52.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

65.3%63.5% - 67.2%

#43 · qwen3.8-27b

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.8-27b

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 51.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

64.9%63.1% - 66.8%

#44 · o4 mini

VALS-AI · Sep 1, 2026

Source label: openai/o4-mini-2025-04-16

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 50%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

64.8%63% - 66.7%

#45 · grok-4.6-high

VALS-AI · Sep 1, 2026

Source label: grok/grok-4.6

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 48.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

64.2%62.3% - 66.1%

#46 · Claude Sonnet 3.5

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-3-5-sonnet-20241022

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 47.7%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

64.1%60.5% - 67.6%

#47 · qwen3.8-max

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.8-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 46.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

64%62.1% - 65.8%

#48 · claude-sonnet-4-5-20250929-thinking

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-sonnet-4-5-20250929-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 46.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

64%62.1% - 65.9%

#49 · inkling

VALS-AI · Sep 1, 2026

Source label: thinkingmachines/inkling

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 46.5%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Thinkingmachines.

64%62.1% - 65.8%

#50 · GPT-5.4 mini

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.4-mini-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 43%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

63.5%61.7% - 65.3%

#51 · Gemini 2.5 Flash

VALS-AI · Sep 1, 2026

Source label: google/gemini-2.5-flash-preview-09-2025

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 41.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

62.6%60.7% - 64.5%

#52 · Claude Sonnet 4

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-sonnet-4-20250514

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 40.7%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

62.5%60.6% - 64.3%

#53 · Claude Sonnet 4.5

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-sonnet-4-20250514

backfilledproxy backfilledBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 40.7%
Last updated: recent
Eligibility: Fallback benchmark identity is visible for context but excluded from default ranking.
Identity: benchmark proxy (0.58)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic. Backfilled from Claude Sonnet 4 via approved benchmark identity mapping map-claude-sonnet-4-5-to-4.

62.5%60.6% - 64.3%

#54 · Inkling Small

VALS-AI · Sep 1, 2026

Source label: thinkingmachines/inkling-small

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 38.4%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Thinkingmachines.

62.3%60.4% - 64.1%

#55 · Claude Haiku 4.5

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-haiku-4-5-20251001-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 37.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

62.2%60.3% - 64%

#56 · Magistral Small 1.2

VALS-AI · Sep 1, 2026

Source label: mistralai/magistral-small-2509

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 36%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

62.1%60.3% - 64%

#57 · grok-4.5

VALS-AI · Sep 1, 2026

Source label: grok/grok-4.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 34.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

61.8%59.9% - 63.7%

#58 · gemma-4-31b-it

VALS-AI · Sep 1, 2026

Source label: google/gemma-4-31b-it

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 33.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

61.4%59.5% - 63.3%

#59 · GPT-5.1

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.1-2025-11-13

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 33.7%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

61.4%59.5% - 63.2%

#60 · Mistral Small (Sep '24)

VALS-AI · Sep 1, 2026

Source label: mistralai/mistral-small-2503

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 31.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

61.2%59.3% - 63.1%

#61 · Claude Opus 4.1

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-1-20250805

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 30.2%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

61.1%59.2% - 63%

#62 · GPT-4o

VALS-AI · Sep 1, 2026

Source label: openai/gpt-4o-2024-08-06

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 29.1%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

61%57.3% - 64.6%

#63 · Qwen3.5 Plus

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.5-plus-thinking

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 27.9%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

60.8%58.9% - 62.7%

#64 · Gemini 2.0 Flash

VALS-AI · Sep 1, 2026

Source label: google/gemini-2.0-flash-exp

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 26.7%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

60.4%56.6% - 64.1%

#65 · mimo-v2.5

VALS-AI · Sep 1, 2026

Source label: xiaomi/mimo-v2.5

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 25.6%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Xiaomi.

59.3%57.3% - 61.2%

#66 · GPT-5.4 nano

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.4-nano-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 24.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

59.1%57.2% - 61%

#67 · Claude Opus 4

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-20250514

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 23.3%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

58.6%56.7% - 60.5%

#68 · llama4-maverick-instruct-basic

VALS-AI · Sep 1, 2026

Source label: fireworks/llama4-maverick-instruct-basic

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 22.1%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Fireworks AI.

58.5%56.6% - 60.4%

#69 · llama-4-scout-17b-16e-instruct

VALS-AI · Sep 1, 2026

Source label: together/meta-llama/Llama-4-Scout-17B-16E-Instruct

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 20.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Together AI.

57.8%55.8% - 59.7%

#70 · Gemini 2.5 Flash-Lite

VALS-AI · Sep 1, 2026

Source label: google/gemini-2.5-flash-lite-preview-09-2025-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 19.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

57.6%55.6% - 59.5%

#71 · Gemini 1.5 Pro

VALS-AI · Sep 1, 2026

Source label: google/gemini-1.5-pro-002

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 18.6%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

56.8%53% - 60.5%

#72 · claude-opus-4-1-20250805-thinking

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-1-20250805-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 17.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

56.1%54.2% - 58.1%

#73 · GPT-4o mini

VALS-AI · Sep 1, 2026

Source label: openai/gpt-4o-mini-2024-07-18

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 16.3%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

54.5%50.7% - 58.3%

#74 · GPT-4.1 nano

VALS-AI · Sep 1, 2026

Source label: openai/gpt-4.1-nano-2025-04-14

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 15.1%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

52.8%50.9% - 54.8%

#75 · Mistral Large (Feb '24)

VALS-AI · Sep 1, 2026

Source label: mistralai/mistral-large-2512

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 14%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

52.1%50.2% - 54.1%

#76 · Magistral Medium 1.2

VALS-AI · Sep 1, 2026

Source label: mistralai/magistral-medium-2509

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 12.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

51.9%49.9% - 53.8%

#77 · Grok 4.3

VALS-AI · Sep 1, 2026

Source label: grok/grok-4.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 11.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

48.3%46.3% - 50.2%

#78 · Grok 4.20

VALS-AI · Sep 1, 2026

Source label: grok/grok-4.20-0309-reasoning

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 10.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

45.4%43.4% - 47.3%

#79 · Grok 4

VALS-AI · Sep 1, 2026

Source label: grok/grok-4-0709

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 9.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

44.5%42.6% - 46.4%

#80 · Gemini 1.5 Flash

VALS-AI · Sep 1, 2026

Source label: google/gemini-1.5-flash-002

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 8.1%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

42.8%39.2% - 46.4%

#81 · Grok 4.1 Fast

VALS-AI · Sep 1, 2026

Source label: grok/grok-4-1-fast-reasoning

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

42.6%40.7% - 44.5%

#82 · Grok 4 Fast

VALS-AI · Sep 1, 2026

Source label: grok/grok-4-fast-reasoning

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 5.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

42.1%40.2% - 44%

#83 · llama-3-2-90b-vision-instruct-turbo

VALS-AI · Sep 1, 2026

Source label: together/meta-llama/Llama-3.2-90B-Vision-Instruct-Turbo

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 4.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Together AI.

38.8%35.1% - 42.5%

#84 · mistral-medium-2505

VALS-AI · Sep 1, 2026

Source label: mistralai/mistral-medium-2505

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 3.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

36.4%35% - 37.9%

#85 · mistral-medium-3.5

VALS-AI · Sep 1, 2026

Source label: mistralai/mistral-medium-3.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 2.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

28.9%27.3% - 30.5%

#86 · llama-3-2-11b-vision-instruct-turbo

VALS-AI · Sep 1, 2026

Source label: together/meta-llama/Llama-3.2-11B-Vision-Instruct-Turbo

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 1.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Together AI.

23.3%20.1% - 26.5%

#87 · Grok 2 Vision

VALS-AI · Sep 1, 2026

Source label: grok/grok-2-vision-1212

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 0%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

3.5%2% - 4.9%

Benchmarks · /benchmarks/vals-ai-mortgage_tax

MortgageTax

MortgageTax result as reported by Vals AI.

Source · Vals AI
Version · vals-ai snapshot 2026-10-03
Scores · 87

Test details

Visible tradeoffsThis is an objective signal, so it is mainly about measurable task performance rather than public taste.

source

Vals AI

metric

Accuracy (%)

judge

Objective

direction

higher better

group id

vals_mortgage_tax_current

domain

Document understanding

What it measures vs what it misses

✓ Measures

Reading and understanding tax certificates as images.

✗ Misses

Adjacent skills outside the benchmark task mix, latency, and cost.

Leaderboard · this benchmark version

#1 · Claude Opus 5 (Adaptive Reasoning, Max Effort)

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 100%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

72.1%70.3% - 73.8%

#2 · Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-fable-5-1

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 98.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

70.8%69% - 72.5%

#3 · Claude Opus 4.7

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-7

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 97.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

70.3%68.5% - 72%

#4 · Claude Sonnet 5 (Adaptive Reasoning, Max Effort)

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-sonnet-5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 96.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

70%68.3% - 71.8%

#5 · Claude Opus 4.8

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-8

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 95.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

69.9%68.2% - 71.7%

#6 · Gemini 3.1 Pro Preview

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.1-pro-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 94.2%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

69.4%67.6% - 71.2%

#7 · Gemini 3 Pro Preview

VALS-AI · Sep 1, 2026

Source label: google/gemini-3-pro-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 93%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

69.1%67.3% - 70.9%

#8 · Claude Fable 5

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-fable-5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 91.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

68.9%67.1% - 70.7%

#9 · Gemini 2.5 Pro

VALS-AI · Sep 1, 2026

Source label: google/gemini-2.5-pro

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 90.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

68.9%67.1% - 70.7%

#10 · GPT-5.5

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 89.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

68.8%67% - 70.5%

#11 · Gemini 3 Flash Preview

VALS-AI · Sep 1, 2026

Source label: google/gemini-3-flash-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 88.4%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

68.7%66.9% - 70.5%

#12 · gemini-3.5-flash-lite

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.5-flash-lite

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 87.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

68.7%66.9% - 70.5%

#13 · Claude Sonnet 3.7

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-3-7-sonnet-20250219

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 87.2%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

68.7%65.2% - 72.2%

#14 · Claude Opus 4.5

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-5-20251101

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 87.2%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

68.7%66.9% - 70.5%

#15 · Claude Opus 4.6

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-6-thinking

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 83.7%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

68.5%66.7% - 70.3%

#16 · minimax-m3

VALS-AI · Sep 1, 2026

Source label: minimax/MiniMax-M3

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 82.6%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: MiniMax.

68.4%66.6% - 70.1%

#17 · GPT-5.4

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.4-2026-03-05

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 81.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

68.3%66.5% - 70.1%

#18 · Qwen3.6 27B (Reasoning)

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.6-27b

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 80.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

68.3%66.5% - 70.1%

#19 · Gemini 3.5 Flash

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.5-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 79.1%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

68.1%66.3% - 69.9%

#20 · Gemini 3.1 Flash-Lite Preview

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.1-flash-lite-preview

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 77.9%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

68%66.3% - 69.8%

#21 · qwen3.6-plus

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.6-plus

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 76.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

68%66.2% - 69.7%

#22 · Claude Sonnet 4.6

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-sonnet-4-6

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 75.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

67.7%65.9% - 69.5%

#23 · claude-opus-4-5-20251101-thinking

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-5-20251101-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 74.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

67.7%65.9% - 69.5%

#24 · gemini-3.6-flash-high

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.6-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 73.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

67.6%65.8% - 69.4%

#25 · Qwen3.5 Flash

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.5-flash

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 72.1%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

67.4%65.6% - 69.2%

#26 · GPT-5.6 Terra

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.6-terra

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 70.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

67.3%65.5% - 69.1%

#27 · GPT-5.6 Luna

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.6-luna

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 69.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

67.3%65.5% - 69.1%

#28 · GPT-5.6 Sol

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.6-sol

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 68.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

67.3%65.5% - 69.1%

#29 · gpt-5.2-2025-12-11

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.2-2025-12-11

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 67.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

67.1%65.3% - 68.9%

#30 · gpt-5-mini-2025-08-07

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5-mini-2025-08-07

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 66.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

66.9%65.1% - 68.7%

#31 · gemini-3.7-flash-high

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.7-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 65.1%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

66.7%64.8% - 68.5%

#32 · kimi-k2.5-thinking

VALS-AI · Sep 1, 2026

Source label: kimi/kimi-k2.5-thinking

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 64%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Moonshot AI.

66.5%64.7% - 68.3%

#33 · kimi-k3-max

VALS-AI · Sep 1, 2026

Source label: kimi/kimi-k3

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 62.8%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Moonshot AI.

66.3%64.6% - 68.1%

#34 · qwen3.7-plus

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.7-plus

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 61.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

66.2%64.4% - 68%

#35 · muse-spark-1.1

VALS-AI · Sep 1, 2026

Source label: meta/muse_spark_1_1

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 60.5%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Meta.

66.1%64.3% - 68%

#36 · GPT-4.1

VALS-AI · Sep 1, 2026

Source label: openai/gpt-4.1-2025-04-14

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 59.3%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

65.9%64.1% - 67.7%

#37 · kimi-k2.6

VALS-AI · Sep 1, 2026

Source label: kimi/kimi-k2.6

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 58.1%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Moonshot AI.

65.8%64% - 67.6%

#38 · o3

VALS-AI · Sep 1, 2026

Source label: openai/o3-2025-04-16

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 57%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

65.7%63.9% - 67.5%

#39 · GPT-4.1 mini

VALS-AI · Sep 1, 2026

Source label: openai/gpt-4.1-mini-2025-04-14

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 55.8%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

65.5%63.7% - 67.3%

#40 · GPT-5

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5-2025-08-07

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 54.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

65.5%63.7% - 67.2%

#41 · muse-spark-1.2 (xHigh)

VALS-AI · Sep 1, 2026

Source label: meta/muse_spark_1_2

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 53.5%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Meta.

65.4%63.6% - 67.3%

#42 · gemini-3.8-flash-high

VALS-AI · Sep 1, 2026

Source label: google/gemini-3.8-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 52.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

65.3%63.5% - 67.2%

#43 · qwen3.8-27b

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.8-27b

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 51.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

64.9%63.1% - 66.8%

#44 · o4 mini

VALS-AI · Sep 1, 2026

Source label: openai/o4-mini-2025-04-16

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 50%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

64.8%63% - 66.7%

#45 · grok-4.6-high

VALS-AI · Sep 1, 2026

Source label: grok/grok-4.6

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 48.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

64.2%62.3% - 66.1%

#46 · Claude Sonnet 3.5

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-3-5-sonnet-20241022

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 47.7%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

64.1%60.5% - 67.6%

#47 · qwen3.8-max

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.8-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 46.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

64%62.1% - 65.8%

#48 · claude-sonnet-4-5-20250929-thinking

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-sonnet-4-5-20250929-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 46.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

64%62.1% - 65.9%

#49 · inkling

VALS-AI · Sep 1, 2026

Source label: thinkingmachines/inkling

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 46.5%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Thinkingmachines.

64%62.1% - 65.8%

#50 · GPT-5.4 mini

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.4-mini-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 43%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

63.5%61.7% - 65.3%

#51 · Gemini 2.5 Flash

VALS-AI · Sep 1, 2026

Source label: google/gemini-2.5-flash-preview-09-2025

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 41.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

62.6%60.7% - 64.5%

#52 · Claude Sonnet 4

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-sonnet-4-20250514

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 40.7%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

62.5%60.6% - 64.3%

#53 · Claude Sonnet 4.5

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-sonnet-4-20250514

backfilledproxy backfilledBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 40.7%
Last updated: recent
Eligibility: Fallback benchmark identity is visible for context but excluded from default ranking.
Identity: benchmark proxy (0.58)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic. Backfilled from Claude Sonnet 4 via approved benchmark identity mapping map-claude-sonnet-4-5-to-4.

62.5%60.6% - 64.3%

#54 · Inkling Small

VALS-AI · Sep 1, 2026

Source label: thinkingmachines/inkling-small

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 38.4%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Thinkingmachines.

62.3%60.4% - 64.1%

#55 · Claude Haiku 4.5

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-haiku-4-5-20251001-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 37.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

62.2%60.3% - 64%

#56 · Magistral Small 1.2

VALS-AI · Sep 1, 2026

Source label: mistralai/magistral-small-2509

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 36%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

62.1%60.3% - 64%

#57 · grok-4.5

VALS-AI · Sep 1, 2026

Source label: grok/grok-4.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 34.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

61.8%59.9% - 63.7%

#58 · gemma-4-31b-it

VALS-AI · Sep 1, 2026

Source label: google/gemma-4-31b-it

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 33.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

61.4%59.5% - 63.3%

#59 · GPT-5.1

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.1-2025-11-13

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 33.7%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

61.4%59.5% - 63.2%

#60 · Mistral Small (Sep '24)

VALS-AI · Sep 1, 2026

Source label: mistralai/mistral-small-2503

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 31.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

61.2%59.3% - 63.1%

#61 · Claude Opus 4.1

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-1-20250805

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 30.2%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

61.1%59.2% - 63%

#62 · GPT-4o

VALS-AI · Sep 1, 2026

Source label: openai/gpt-4o-2024-08-06

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 29.1%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

61%57.3% - 64.6%

#63 · Qwen3.5 Plus

VALS-AI · Sep 1, 2026

Source label: alibaba/qwen3.5-plus-thinking

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 27.9%
Last updated: recent
Eligibility: preview_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Alibaba.

60.8%58.9% - 62.7%

#64 · Gemini 2.0 Flash

VALS-AI · Sep 1, 2026

Source label: google/gemini-2.0-flash-exp

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 26.7%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

60.4%56.6% - 64.1%

#65 · mimo-v2.5

VALS-AI · Sep 1, 2026

Source label: xiaomi/mimo-v2.5

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 25.6%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Xiaomi.

59.3%57.3% - 61.2%

#66 · GPT-5.4 nano

VALS-AI · Sep 1, 2026

Source label: openai/gpt-5.4-nano-2026-03-17

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 24.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

59.1%57.2% - 61%

#67 · Claude Opus 4

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-20250514

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 23.3%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

58.6%56.7% - 60.5%

#68 · llama4-maverick-instruct-basic

VALS-AI · Sep 1, 2026

Source label: fireworks/llama4-maverick-instruct-basic

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 22.1%
Last updated: recent
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Fireworks AI.

58.5%56.6% - 60.4%

#69 · llama-4-scout-17b-16e-instruct

VALS-AI · Sep 1, 2026

Source label: together/meta-llama/Llama-4-Scout-17B-16E-Instruct

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 20.9%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Together AI.

57.8%55.8% - 59.7%

#70 · Gemini 2.5 Flash-Lite

VALS-AI · Sep 1, 2026

Source label: google/gemini-2.5-flash-lite-preview-09-2025-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 19.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

57.6%55.6% - 59.5%

#71 · Gemini 1.5 Pro

VALS-AI · Sep 1, 2026

Source label: google/gemini-1.5-pro-002

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 18.6%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

56.8%53% - 60.5%

#72 · claude-opus-4-1-20250805-thinking

VALS-AI · Sep 1, 2026

Source label: anthropic/claude-opus-4-1-20250805-thinking

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 17.4%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Anthropic.

56.1%54.2% - 58.1%

#73 · GPT-4o mini

VALS-AI · Sep 1, 2026

Source label: openai/gpt-4o-mini-2024-07-18

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 16.3%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

54.5%50.7% - 58.3%

#74 · GPT-4.1 nano

VALS-AI · Sep 1, 2026

Source label: openai/gpt-4.1-nano-2025-04-14

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 15.1%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: OpenAI.

52.8%50.9% - 54.8%

#75 · Mistral Large (Feb '24)

VALS-AI · Sep 1, 2026

Source label: mistralai/mistral-large-2512

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 14%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

52.1%50.2% - 54.1%

#76 · Magistral Medium 1.2

VALS-AI · Sep 1, 2026

Source label: mistralai/magistral-medium-2509

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 12.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

51.9%49.9% - 53.8%

#77 · Grok 4.3

VALS-AI · Sep 1, 2026

Source label: grok/grok-4.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 11.6%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

48.3%46.3% - 50.2%

#78 · Grok 4.20

VALS-AI · Sep 1, 2026

Source label: grok/grok-4.20-0309-reasoning

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 10.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

45.4%43.4% - 47.3%

#79 · Grok 4

VALS-AI · Sep 1, 2026

Source label: grok/grok-4-0709

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 9.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

44.5%42.6% - 46.4%

#80 · Gemini 1.5 Flash

VALS-AI · Sep 1, 2026

Source label: google/gemini-1.5-flash-002

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 8.1%
Last updated: recent
Eligibility: historical_model
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Google.

42.8%39.2% - 46.4%

#81 · Grok 4.1 Fast

VALS-AI · Sep 1, 2026

Source label: grok/grok-4-1-fast-reasoning

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

42.6%40.7% - 44.5%

#82 · Grok 4 Fast

VALS-AI · Sep 1, 2026

Source label: grok/grok-4-fast-reasoning

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 5.8%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

42.1%40.2% - 44%

#83 · llama-3-2-90b-vision-instruct-turbo

VALS-AI · Sep 1, 2026

Source label: together/meta-llama/Llama-3.2-90B-Vision-Instruct-Turbo

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 4.7%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Together AI.

38.8%35.1% - 42.5%

#84 · mistral-medium-2505

VALS-AI · Sep 1, 2026

Source label: mistralai/mistral-medium-2505

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 3.5%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

36.4%35% - 37.9%

#85 · mistral-medium-3.5

VALS-AI · Sep 1, 2026

Source label: mistralai/mistral-medium-3.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 2.3%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Mistral AI.

28.9%27.3% - 30.5%

#86 · llama-3-2-11b-vision-instruct-turbo

VALS-AI · Sep 1, 2026

Source label: together/meta-llama/Llama-3.2-11B-Vision-Instruct-Turbo

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 1.2%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: Together AI.

23.3%20.1% - 26.5%

#87 · Grok 2 Vision

VALS-AI · Sep 1, 2026

Source label: grok/grok-2-vision-1212

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://www.vals.ai/benchmarks/mortgage_tax
Percentile: 0%
Last updated: recent
Eligibility: headline eligible
Identity: provider alias (0.92)

Parsed from Vals AI BenchmarkView overall scores. Vals slug: mortgage_tax; provider: SpaceXAI.

3.5%2% - 4.9%

MortgageTax

Test details

What it measures vs what it misses

✓ Measures

✗ Misses

Leaderboard · this benchmark version

Loading benchmark evidence.

MortgageTax

Test details

What it measures vs what it misses

✓ Measures

✗ Misses

Leaderboard · this benchmark version