Text Arena · Expert
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena expert leaderboard.
Rank #70
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,480
- Percentile
- 78.9%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: expert. Source rank: #73. Votes: 5906. Organization: deepseek. License: MIT.
78.9% percentile inside its fair comparison set1,480Raw benchmark valueCI 1,471 - 1,488
Text Arena · Industry Business And Management And Financial Operations
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_business_and_management_and_financial_operations leaderboard.
Rank #56
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,460
- Percentile
- 85.1%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_business_and_management_and_financial_operations. Source rank: #60. Votes: 11381. Organization: deepseek. License: MIT.
85.1% percentile inside its fair comparison set1,460Raw benchmark valueCI 1,453 - 1,467
Text Arena · Industry Entertainment And Sports And Media
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_entertainment_and_sports_and_media leaderboard.
Rank #55
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,435
- Percentile
- 85.6%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_entertainment_and_sports_and_media. Source rank: #60. Votes: 12770. Organization: deepseek. License: MIT.
85.6% percentile inside its fair comparison set1,435Raw benchmark valueCI 1,428 - 1,441
Text Arena · Industry Legal And Government
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_legal_and_government leaderboard.
Rank #46
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,474
- Percentile
- 87.1%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_legal_and_government. Source rank: #49. Votes: 4500. Organization: deepseek. License: MIT.
87.1% percentile inside its fair comparison set1,474Raw benchmark valueCI 1,465 - 1,484
Text Arena · Industry Life And Physical And Social Science
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_life_and_physical_and_social_science leaderboard.
Rank #54
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,481
- Percentile
- 85.8%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_life_and_physical_and_social_science. Source rank: #56. Votes: 9142. Organization: deepseek. License: MIT.
85.8% percentile inside its fair comparison set1,481Raw benchmark valueCI 1,474 - 1,488
Text Arena · Industry Mathematical
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_mathematical leaderboard.
Rank #64
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,460
- Percentile
- 82.3%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_mathematical. Source rank: #67. Votes: 3288. Organization: deepseek. License: MIT.
82.3% percentile inside its fair comparison set1,460Raw benchmark valueCI 1,449 - 1,471
Text Arena · Industry Medicine And Healthcare
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_medicine_and_healthcare leaderboard.
Rank #57
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,478
- Percentile
- 83.8%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_medicine_and_healthcare. Source rank: #62. Votes: 4050. Organization: deepseek. License: MIT.
83.8% percentile inside its fair comparison set1,478Raw benchmark valueCI 1,468 - 1,488
Text Arena · Industry Software And It Services
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_software_and_it_services leaderboard.
Rank #65
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,492
- Percentile
- 83%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_software_and_it_services. Source rank: #70. Votes: 23627. Organization: deepseek. License: MIT.
83% percentile inside its fair comparison set1,492Raw benchmark valueCI 1,486 - 1,497
Text Arena · Industry Writing And Literature And Language
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_writing_and_literature_and_language leaderboard.
Rank #50
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,451
- Percentile
- 86.9%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_writing_and_literature_and_language. Source rank: #53. Votes: 14128. Organization: deepseek. License: MIT.
86.9% percentile inside its fair comparison set1,451Raw benchmark valueCI 1,444 - 1,457
Text Arena · Expert · No Style Control
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena expert leaderboard.
Rank #62
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,463
- Percentile
- 81.3%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: expert. Source rank: #65. Votes: 5906. Organization: deepseek. License: MIT.
81.3% percentile inside its fair comparison set1,463Raw benchmark valueCI 1,455 - 1,471
Text Arena · Industry Business And Management And Financial Operations · No Style Control
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_business_and_management_and_financial_operations leaderboard.
Rank #47
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,443
- Percentile
- 87.5%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_business_and_management_and_financial_operations. Source rank: #50. Votes: 11381. Organization: deepseek. License: MIT.
87.5% percentile inside its fair comparison set1,443Raw benchmark valueCI 1,437 - 1,450
Text Arena · Industry Entertainment And Sports And Media · No Style Control
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_entertainment_and_sports_and_media leaderboard.
Rank #44
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,430
- Percentile
- 88.5%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_entertainment_and_sports_and_media. Source rank: #46. Votes: 12770. Organization: deepseek. License: MIT.
88.5% percentile inside its fair comparison set1,430Raw benchmark valueCI 1,423 - 1,437
Text Arena · Industry Legal And Government · No Style Control
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_legal_and_government leaderboard.
Rank #43
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,464
- Percentile
- 88%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_legal_and_government. Source rank: #45. Votes: 4500. Organization: deepseek. License: MIT.
88% percentile inside its fair comparison set1,464Raw benchmark valueCI 1,455 - 1,474
Text Arena · Industry Life And Physical And Social Science · No Style Control
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_life_and_physical_and_social_science leaderboard.
Rank #41
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,470
- Percentile
- 89.3%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_life_and_physical_and_social_science. Source rank: #43. Votes: 9142. Organization: deepseek. License: MIT.
89.3% percentile inside its fair comparison set1,470Raw benchmark valueCI 1,463 - 1,477
Text Arena · Industry Mathematical · No Style Control
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_mathematical leaderboard.
Rank #62
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,455
- Percentile
- 82.9%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_mathematical. Source rank: #65. Votes: 3288. Organization: deepseek. License: MIT.
82.9% percentile inside its fair comparison set1,455Raw benchmark valueCI 1,444 - 1,466
Text Arena · Industry Medicine And Healthcare · No Style Control
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_medicine_and_healthcare leaderboard.
Rank #43
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,465
- Percentile
- 87.9%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_medicine_and_healthcare. Source rank: #44. Votes: 4050. Organization: deepseek. License: MIT.
87.9% percentile inside its fair comparison set1,465Raw benchmark valueCI 1,455 - 1,475
Text Arena · Industry Software And It Services · No Style Control
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_software_and_it_services leaderboard.
Rank #59
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,469
- Percentile
- 84.6%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_software_and_it_services. Source rank: #62. Votes: 23627. Organization: deepseek. License: MIT.
84.6% percentile inside its fair comparison set1,469Raw benchmark valueCI 1,463 - 1,474
Text Arena · Industry Writing And Literature And Language · No Style Control
AR · Professional reasoning · Human
Observed user preference in Arena's Text Arena industry_writing_and_literature_and_language leaderboard.
Rank #42
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Arena
- Raw value
- 1,446
- Percentile
- 89.1%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Arena leaderboard dataset row `deepseek-v4-pro`. Category: industry_writing_and_literature_and_language. Source rank: #45. Votes: 14128. Organization: deepseek. License: MIT.
89.1% percentile inside its fair comparison set1,446Raw benchmark valueCI 1,440 - 1,453
Vals Index
VALS-AI · Professional reasoning · Combined
Weighted model performance across economically relevant Vals tasks.
Rank #34 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 39
- Percentile
- 17.5%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: vals_index; provider: DeepSeek.
17.5% percentile inside its fair comparison set39Raw benchmark valueCI 36 - 41
Legal Research Bench
VALS-AI · Professional reasoning · Objective
Applied legal research tasks.
Rank #47 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 23.1%
- Percentile
- 32.4%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: legal_research; provider: DeepSeek.
32.4% percentile inside its fair comparison set23.1%Raw benchmark valueCI 17.3% - 28.8%
Harvey's Legal Agent Benchmark
VALS-AI · Professional reasoning · Objective
Completing legal work with documents, spreadsheets, presentations, and file-system tools.
Rank #33 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 3.8%
- Percentile
- 53.6%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: hlab; provider: DeepSeek.
53.6% percentile inside its fair comparison set3.8%Raw benchmark valueCI 0.9% - 6.6%
LegalBench
VALS-AI · Professional reasoning · Objective
Academic legal reasoning tasks.
Rank #84 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 80.3%
- Percentile
- 38.5%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: legal_bench; provider: DeepSeek.
38.5% percentile inside its fair comparison set80.3%Raw benchmark valueCI 79.4% - 81.2%
Finance Agent v2
VALS-AI · Professional reasoning · Objective
Core financial analyst tasks for agentic models.
Rank #49 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 44.1%
- Percentile
- 30.4%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: fabv2; provider: DeepSeek.
30.4% percentile inside its fair comparison set44.1%Raw benchmark valueCI 42.8% - 45.4%
MedCode
VALS-AI · Professional reasoning · Objective
Medical billing support and coding tasks.
Rank #63 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 40.5%
- Percentile
- 34.7%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: medcode; provider: DeepSeek.
34.7% percentile inside its fair comparison set40.5%Raw benchmark valueCI 36.3% - 44.6%
MedScribe
VALS-AI · Professional reasoning · Objective
Administrative documentation support for doctors.
Rank #72 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 75.1%
- Percentile
- 26%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: medscribe; provider: DeepSeek.
26% percentile inside its fair comparison set75.1%Raw benchmark valueCI 71.2% - 79.1%
Public Benefits Bench
VALS-AI · Professional reasoning · Objective
Answering SNAP benefits questions across the public-benefits lifecycle.
Rank #22 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 62.9%
- Percentile
- 53.3%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: public-benefits-bench; provider: DeepSeek.
53.3% percentile inside its fair comparison set62.9%Raw benchmark valueCI 60.5% - 65.4%
SkillsBench
VALS-AI · Professional reasoning · Objective
Applied professional skills tasks.
Rank #20 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 51.3%
- Percentile
- 42.4%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: skillsbench; provider: DeepSeek.
42.4% percentile inside its fair comparison set51.3%Raw benchmark valueCI 42.3% - 60.3%
TaxEval v2
VALS-AI · Professional reasoning · Objective
Answer quality on tax questions and responses.
Rank #66 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 72.1%
- Percentile
- 49.6%
- Last updated
- recent
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: tax_eval_v2; provider: DeepSeek.
49.6% percentile inside its fair comparison set72.1%Raw benchmark valueCI 70.4% - 73.8%
Data analysis
LB · Professional reasoning · Objective
Structured data manipulation and table reasoning accuracy.
Rank #37
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- LiveBench
- Raw value
- 74.5%
- Percentile
- 44.6%
- Last updated
- stale
- Eligibility
- headline eligible
Derived from the official LiveBench website leaderboard table. Category: Data Analysis. Tasks scored: 3.
44.6% percentile inside its fair comparison set74.5%Raw benchmark value
Overall
LB · Professional reasoning · Objective
Average objective performance across LiveBench's current public category mix.
Rank #53
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- LiveBench
- Raw value
- 71.6%
- Percentile
- 20%
- Last updated
- stale
- Eligibility
- headline eligible
Derived from the official LiveBench website leaderboard table. Category averages included: 7.
20% percentile inside its fair comparison set71.6%Raw benchmark value
Consecutive events
LB · Professional reasoning · Objective
Objective consecutive events score in LiveBench.
Rank #42
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- LiveBench
- Raw value
- 75.4%
- Percentile
- 36.9%
- Last updated
- stale
- Eligibility
- headline eligible
Derived from the official LiveBench website leaderboard table. Task: consecutive_events. Category: Data Analysis.
36.9% percentile inside its fair comparison set75.4%Raw benchmark value
Table join
LB · Professional reasoning · Objective
Objective table join score in LiveBench.
Rank #33
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- LiveBench
- Raw value
- 48.2%
- Percentile
- 50.8%
- Last updated
- stale
- Eligibility
- headline eligible
Derived from the official LiveBench website leaderboard table. Task: tablejoin. Category: Data Analysis.
50.8% percentile inside its fair comparison set48.2%Raw benchmark value
Table reformat
LB · Professional reasoning · Objective
Objective table reformat score in LiveBench.
Rank #1
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- LiveBench
- Raw value
- 100%
- Percentile
- 100%
- Last updated
- stale
- Eligibility
- headline eligible
Derived from the official LiveBench website leaderboard table. Task: tablereformat. Category: Data Analysis.
100% percentile inside its fair comparison set100%Raw benchmark value
Public Benefits Bench v1
VALS-AI · Professional reasoning · Objective
Answering public-benefits questions across the benefits lifecycle.
Rank #7 · Source label: deepseek/deepseek-v4-pro
verified runtimeexact alias
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- Vals AI
- Raw value
- 57.6%
- Percentile
- 50%
- Last updated
- stale
- Eligibility
- headline eligible
Parsed from Vals AI BenchmarkView overall scores. Vals slug: public-benefits-bench-v1; provider: DeepSeek.
50% percentile inside its fair comparison set57.6%Raw benchmark valueCI 55.1% - 60.1%
Hallucination
BB · Professional reasoning · Rubric
Accuracy and fabrication resistance under prompts that invite unsupported claims.
Rank #35 · Source label: openrouter/deepseek/deepseek-v4-pro
verified runtimeexact aliasBackground only
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- BridgeBench
- Raw value
- 51.1%
- Percentile
- 0%
- Last updated
- archived
- Eligibility
- benchmark_derived_model
Parsed from the BridgeBench page for bridgebench-hallucination.
0% percentile inside its fair comparison set51.1%Raw benchmark value
BS pushback
BB · Professional reasoning · Rubric
Resistance to confidently accepting bogus assumptions in expert-style prompts.
Rank #19 · Source label: openrouter/deepseek/deepseek-v4-pro
verified runtimeexact aliasBackground only
Raw row drilldownsource row, percentile, last updated, eligibility
- Source
- BridgeBench
- Raw value
- 36%
- Percentile
- 5.6%
- Last updated
- archived
- Eligibility
- benchmark_derived_model
Parsed from the BridgeBench page for bridgebench-pushback.
5.6% percentile inside its fair comparison set36%Raw benchmark value