Benchmarks · /benchmarks/livebench-instruction-following

Instruction following

Name: Instruction following
Creator: LiveBench

LiveBench instruction-following category across paraphrase, simplify, story, and summarize tasks.

Source · LiveBench
Version · livebench snapshot 2026-10-03
Scores · 66

Test details

Verified but agingThis is an objective signal, so it is mainly about measurable task performance rather than public taste.

source

LiveBench

metric

Score (%)

judge

Objective

direction

higher better

group id

livebench_instruction_following_2026_01_08

domain

Chat / text

What it measures vs what it misses

✓ Measures

How well a model obeys specified output instructions on recent tasks.

✗ Misses

Broader reasoning depth, human preference over style, and cost.

Why this countsIt tests whether the model is actually useful in normal conversational turns, not just on narrow correctness tasks.Same-test ruleThis percentile only compares models inside the exact benchmark/version group shown here. It is not a universal score.What it missesIt does not prove deeper reasoning, tool use, or enterprise workflow reliability.

Leaderboard · this benchmark version

#1 · gemini-3.8-flash-high

LB · Jun 25, 2026

Source label: gemini-3.8-flash-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 100%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

81.4%

#2 · gemini-3.7-flash-high

LB · Jun 25, 2026

Source label: gemini-3.7-flash-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 98.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

79.9%

#3 · gemini-3.1-pro-preview-high

LB · Jun 25, 2026

Source label: gemini-3.1-pro-preview-high

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 96.9%
Last updated: stale
Eligibility: preview_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

79.1%

#4 · muse-spark-1.3 (xHigh)

LB · Jun 25, 2026

Source label: muse-spark-1.3-xhigh

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 95.4%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

78%

#5 · qwen3.8-flash-next

LB · Jun 25, 2026

Source label: qwen3.8-flash-next

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 93.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

77.1%

#6 · claude-fable-5-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 92.3%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

75.8%

#7 · Gemini 3.5 Flash

LB · Jun 25, 2026

Source label: gemini-3.5-flash-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 90.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

75.6%

#8 · gpt-6-astra-max

LB · Jun 25, 2026

Source label: gpt-6-astra-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 89.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

75.6%

#9 · gemini-3.6-flash-high

LB · Jun 25, 2026

Source label: gemini-3.6-flash-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 87.7%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

75.4%

#10 · grok-4.7-xhigh

LB · Jun 25, 2026

Source label: grok-4.7-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 86.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

75.3%

#11 · muse-spark-1.2 (xHigh)

LB · Jun 25, 2026

Source label: muse-spark-1.2-xhigh

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 84.6%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

74.3%

#12 · gpt-6.1-sol-max

LB · Jun 25, 2026

Source label: gpt-6.1-sol-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 83.1%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

74.2%

#13 · qwen3.8-max

LB · Jun 25, 2026

Source label: qwen3.8-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 81.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

74.1%

#14 · Qwen3.7 Max

LB · Jun 25, 2026

Source label: qwen3.7-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 80%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

74%

#15 · smaug-mini

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 78.5%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

73.9%

#16 · nemotron-3-ultra-550b-a55b

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 76.9%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

73.4%

#17 · claude-fable-5-1-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 75.4%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

73%

#18 · qwen3.8-27b

LB · Jun 25, 2026

Source label: qwen3.8-27b

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 73.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

72.7%

#19 · claude-opus-4-8-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 72.3%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

72%

#20 · grok-4.6-high

LB · Jun 25, 2026

Source label: grok-4.6

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 70.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71.9%

#21 · GPT-5.6 Sol

LB · Jun 25, 2026

Source label: gpt-5.6-sol-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 69.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71.8%

#22 · grok-4.5

LB · Jun 25, 2026

Source label: grok-4.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 67.7%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71.5%

#23 · kimi-k3-max

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 66.2%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71.4%

#24 · GPT-6.1 Sol (Xhigh)

LB · Jun 25, 2026

Source label: gpt-6.1-sol-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 64.6%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71.3%

#25 · smaug-agentic

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 63.1%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71%

#26 · deepseek-v4-flash-vision-exp

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 61.5%
Last updated: stale
Eligibility: preview_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71%

#27 · GPT-5.5

LB · Jun 25, 2026

Source label: gpt-5.5-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 60%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

70.7%

#28 · claude-sonnet-5-5-xhigh-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 58.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

70.5%

#29 · GPT-5.4

LB · Jun 25, 2026

Source label: gpt-5.4-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 56.9%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

70.2%

#30 · inkling

LB · Jun 25, 2026

Source label: inkling-xhigh

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 55.4%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

70.1%

#31 · deepseek-v4.1-flash-max

LB · Jun 25, 2026

Source label: deepseek-v4.1-flash-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 53.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

70%

#32 · muse-spark-1.1

LB · Jun 25, 2026

Source label: muse-spark-1.1-xhigh

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 52.3%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

69.6%

#33 · glm-5.3-max

LB · Jun 25, 2026

Source label: glm-5.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 50.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

69.3%

#34 · smaug-flash

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 49.2%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

69.3%

#35 · gpt-6-sol-max

LB · Jun 25, 2026

Source label: gpt-6-sol-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 47.7%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

68.6%

#36 · deepseek-v4-pro-0813

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 46.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

67.7%

#37 · gemini-3.5-flash-lite-high

LB · Jun 25, 2026

Source label: gemini-3.5-flash-lite-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 44.6%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

67.2%

#38 · GPT-5.4 nano

LB · Jun 25, 2026

Source label: gpt-5.4-nano-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 43.1%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

67.2%

#39 · claude-opus-5-5-xhigh-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 41.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

67.1%

#40 · claude-opus-4-7-xhigh-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 40%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

66.7%

#41 · GPT-5.2

LB · Jun 25, 2026

Source label: gpt-5.2-codex

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 38.5%
Last updated: stale
Eligibility: historical_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

66.4%

#42 · claude-opus-5-5-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 36.9%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

65.7%

#43 · deepseek-v4-flash-0731

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 35.4%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

65.5%

#44 · grok-build-0.1

LB · Jun 25, 2026

Source label: grok-build-0.1

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 33.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

65.2%

#45 · GPT-5.6 Terra

LB · Jun 25, 2026

Source label: gpt-5.6-terra-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 32.3%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

64.6%

#46 · kimi-k2.6-thinking

LB · Jun 25, 2026

Source label: kimi-k2.6-thinking

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 30.8%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

64.4%

#47 · claude-sonnet-5-xhigh-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 29.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

63.9%

#48 · claude-opus-5-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 27.7%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

63.8%

#49 · claude-opus-4-6-thinking-auto-high-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 26.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

63.3%

#50 · claude-sonnet-4-6-thinking-auto-medium-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 24.6%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

63.2%

#51 · deepseek-v4-flash

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 23.1%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

63.1%

#52 · Grok 4.3

LB · Jun 25, 2026

Source label: grok-4.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 21.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

62.8%

#53 · claude-opus-4-5-20251101-thinking-64k-high-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 20%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

62.5%

#54 · deepseek-v4-pro

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 18.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

62.4%

#55 · glm-5.2-max

LB · Jun 25, 2026

Source label: glm-5.2

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 16.9%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

62.3%

#56 · gpt-5.2-2025-12-11-high

LB · Jun 25, 2026

Source label: gpt-5.2-2025-12-11-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 15.4%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

61.8%

#57 · ox-alpha-max

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 13.8%
Last updated: stale
Eligibility: preview_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

60.3%

#58 · GPT-5.6 Luna

LB · Jun 25, 2026

Source label: gpt-5.6-luna-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 12.3%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

60.1%

#59 · GPT-5.4 mini

LB · Jun 25, 2026

Source label: gpt-5.4-mini-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 10.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

59.8%

#60 · qwen3.6-plus

LB · Jun 25, 2026

Source label: qwen3.6-plus

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 9.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

58.3%

#61 · minimax-m3

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 7.7%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

57.5%

#62 · claude-sonnet-5-5-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 6.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

56.8%

#63 · kimi-k2.7-code

LB · Jun 25, 2026

Source label: kimi-k2.7-code

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 4.6%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

56.3%

#64 · gpt-6-luna-max

LB · Jun 25, 2026

Source label: gpt-6-luna-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 3.1%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

55.9%

#65 · Qwen3.6 27B (Reasoning)

LB · Jun 25, 2026

Source label: qwen3.6-27b

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 1.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

53.2%

#66 · glm-5.3-flash

LB · Jun 25, 2026

Source label: glm-5.3-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 0%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

52.8%

Benchmarks · /benchmarks/livebench-instruction-following

Instruction following

LiveBench instruction-following category across paraphrase, simplify, story, and summarize tasks.

Source · LiveBench
Version · livebench snapshot 2026-10-03
Scores · 66

Test details

Verified but agingThis is an objective signal, so it is mainly about measurable task performance rather than public taste.

source

LiveBench

metric

Score (%)

judge

Objective

direction

higher better

group id

livebench_instruction_following_2026_01_08

domain

Chat / text

What it measures vs what it misses

✓ Measures

How well a model obeys specified output instructions on recent tasks.

✗ Misses

Broader reasoning depth, human preference over style, and cost.

Leaderboard · this benchmark version

#1 · gemini-3.8-flash-high

LB · Jun 25, 2026

Source label: gemini-3.8-flash-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 100%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

81.4%

#2 · gemini-3.7-flash-high

LB · Jun 25, 2026

Source label: gemini-3.7-flash-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 98.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

79.9%

#3 · gemini-3.1-pro-preview-high

LB · Jun 25, 2026

Source label: gemini-3.1-pro-preview-high

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 96.9%
Last updated: stale
Eligibility: preview_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

79.1%

#4 · muse-spark-1.3 (xHigh)

LB · Jun 25, 2026

Source label: muse-spark-1.3-xhigh

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 95.4%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

78%

#5 · qwen3.8-flash-next

LB · Jun 25, 2026

Source label: qwen3.8-flash-next

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 93.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

77.1%

#6 · claude-fable-5-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 92.3%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

75.8%

#7 · Gemini 3.5 Flash

LB · Jun 25, 2026

Source label: gemini-3.5-flash-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 90.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

75.6%

#8 · gpt-6-astra-max

LB · Jun 25, 2026

Source label: gpt-6-astra-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 89.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

75.6%

#9 · gemini-3.6-flash-high

LB · Jun 25, 2026

Source label: gemini-3.6-flash-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 87.7%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

75.4%

#10 · grok-4.7-xhigh

LB · Jun 25, 2026

Source label: grok-4.7-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 86.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

75.3%

#11 · muse-spark-1.2 (xHigh)

LB · Jun 25, 2026

Source label: muse-spark-1.2-xhigh

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 84.6%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

74.3%

#12 · gpt-6.1-sol-max

LB · Jun 25, 2026

Source label: gpt-6.1-sol-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 83.1%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

74.2%

#13 · qwen3.8-max

LB · Jun 25, 2026

Source label: qwen3.8-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 81.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

74.1%

#14 · Qwen3.7 Max

LB · Jun 25, 2026

Source label: qwen3.7-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 80%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

74%

#15 · smaug-mini

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 78.5%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

73.9%

#16 · nemotron-3-ultra-550b-a55b

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 76.9%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

73.4%

#17 · claude-fable-5-1-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 75.4%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

73%

#18 · qwen3.8-27b

LB · Jun 25, 2026

Source label: qwen3.8-27b

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 73.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

72.7%

#19 · claude-opus-4-8-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 72.3%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

72%

#20 · grok-4.6-high

LB · Jun 25, 2026

Source label: grok-4.6

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 70.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71.9%

#21 · GPT-5.6 Sol

LB · Jun 25, 2026

Source label: gpt-5.6-sol-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 69.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71.8%

#22 · grok-4.5

LB · Jun 25, 2026

Source label: grok-4.5

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 67.7%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71.5%

#23 · kimi-k3-max

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 66.2%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71.4%

#24 · GPT-6.1 Sol (Xhigh)

LB · Jun 25, 2026

Source label: gpt-6.1-sol-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 64.6%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71.3%

#25 · smaug-agentic

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 63.1%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71%

#26 · deepseek-v4-flash-vision-exp

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 61.5%
Last updated: stale
Eligibility: preview_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

71%

#27 · GPT-5.5

LB · Jun 25, 2026

Source label: gpt-5.5-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 60%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

70.7%

#28 · claude-sonnet-5-5-xhigh-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 58.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

70.5%

#29 · GPT-5.4

LB · Jun 25, 2026

Source label: gpt-5.4-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 56.9%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

70.2%

#30 · inkling

LB · Jun 25, 2026

Source label: inkling-xhigh

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 55.4%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

70.1%

#31 · deepseek-v4.1-flash-max

LB · Jun 25, 2026

Source label: deepseek-v4.1-flash-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 53.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

70%

#32 · muse-spark-1.1

LB · Jun 25, 2026

Source label: muse-spark-1.1-xhigh

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 52.3%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

69.6%

#33 · glm-5.3-max

LB · Jun 25, 2026

Source label: glm-5.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 50.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

69.3%

#34 · smaug-flash

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 49.2%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

69.3%

#35 · gpt-6-sol-max

LB · Jun 25, 2026

Source label: gpt-6-sol-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 47.7%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

68.6%

#36 · deepseek-v4-pro-0813

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 46.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

67.7%

#37 · gemini-3.5-flash-lite-high

LB · Jun 25, 2026

Source label: gemini-3.5-flash-lite-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 44.6%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

67.2%

#38 · GPT-5.4 nano

LB · Jun 25, 2026

Source label: gpt-5.4-nano-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 43.1%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

67.2%

#39 · claude-opus-5-5-xhigh-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 41.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

67.1%

#40 · claude-opus-4-7-xhigh-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 40%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

66.7%

#41 · GPT-5.2

LB · Jun 25, 2026

Source label: gpt-5.2-codex

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 38.5%
Last updated: stale
Eligibility: historical_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

66.4%

#42 · claude-opus-5-5-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 36.9%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

65.7%

#43 · deepseek-v4-flash-0731

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 35.4%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

65.5%

#44 · grok-build-0.1

LB · Jun 25, 2026

Source label: grok-build-0.1

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 33.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

65.2%

#45 · GPT-5.6 Terra

LB · Jun 25, 2026

Source label: gpt-5.6-terra-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 32.3%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

64.6%

#46 · kimi-k2.6-thinking

LB · Jun 25, 2026

Source label: kimi-k2.6-thinking

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 30.8%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

64.4%

#47 · claude-sonnet-5-xhigh-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 29.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

63.9%

#48 · claude-opus-5-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 27.7%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

63.8%

#49 · claude-opus-4-6-thinking-auto-high-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 26.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

63.3%

#50 · claude-sonnet-4-6-thinking-auto-medium-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 24.6%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

63.2%

#51 · deepseek-v4-flash

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 23.1%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

63.1%

#52 · Grok 4.3

LB · Jun 25, 2026

Source label: grok-4.3

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 21.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

62.8%

#53 · claude-opus-4-5-20251101-thinking-64k-high-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 20%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

62.5%

#54 · deepseek-v4-pro

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 18.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

62.4%

#55 · glm-5.2-max

LB · Jun 25, 2026

Source label: glm-5.2

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 16.9%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

62.3%

#56 · gpt-5.2-2025-12-11-high

LB · Jun 25, 2026

Source label: gpt-5.2-2025-12-11-high

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 15.4%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

61.8%

#57 · ox-alpha-max

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 13.8%
Last updated: stale
Eligibility: preview_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

60.3%

#58 · GPT-5.6 Luna

LB · Jun 25, 2026

Source label: gpt-5.6-luna-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 12.3%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

60.1%

#59 · GPT-5.4 mini

LB · Jun 25, 2026

Source label: gpt-5.4-mini-xhigh

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 10.8%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

59.8%

#60 · qwen3.6-plus

LB · Jun 25, 2026

Source label: qwen3.6-plus

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 9.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

58.3%

#61 · minimax-m3

LB · Jun 25, 2026

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 7.7%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

57.5%

#62 · claude-sonnet-5-5-max-effort

LB · Jun 25, 2026

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 6.2%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

56.8%

#63 · kimi-k2.7-code

LB · Jun 25, 2026

Source label: kimi-k2.7-code

verified runtimeexact aliasBackground only

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 4.6%
Last updated: stale
Eligibility: benchmark_derived_model
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

56.3%

#64 · gpt-6-luna-max

LB · Jun 25, 2026

Source label: gpt-6-luna-max

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 3.1%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

55.9%

#65 · Qwen3.6 27B (Reasoning)

LB · Jun 25, 2026

Source label: qwen3.6-27b

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 1.5%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

53.2%

#66 · glm-5.3-flash

LB · Jun 25, 2026

Source label: glm-5.3-flash

verified runtimeexact alias

Raw row drilldownsource, percentile, eligibility

Source URL: https://livebench.ai/table_2026_06_25.csv
Percentile: 0%
Last updated: stale
Eligibility: headline eligible
Identity: provider alias (0.92)

Derived from the official LiveBench website leaderboard table. Category: IF. Tasks scored: 4.

52.8%

Instruction following

Test details

What it measures vs what it misses

✓ Measures

✗ Misses

Leaderboard · this benchmark version

Loading benchmark evidence.

Instruction following

Test details

What it measures vs what it misses

✓ Measures

✗ Misses

Leaderboard · this benchmark version