Start free trial

TRUE, BUTCherry-Picked Slice

Same model scores 7.78% on ARC-AGI-3

Read that as abstract reasoning solved, then look one column over on the same scorecard: the same model, same maximum effort, scores 7.78% on ARC-AGI-3, the interactive benchmark the same team built next, where humans still score 100%.

“GPT-5.6 Sol leads the ARC-AGI-2 leaderboard at 92.5%, clearing the abstract-reasoning benchmark built specifically to resist AI and beating the average human, a result read as frontier models cracking fluid reasoning.”

ARC Prize verified leaderboard and coverage (GPT-5.6 Sol, ARC-AGI-2, August 2026)

Recorded 19 August 2026. Our ruling means: literally true, materially misleading.

Read the story →

Receipts pack

The evidence file for this verdict

7 receipts: 1 support the claim, 2 contradict it, 4 add context. 4 figures on the record, 4 traced to a quoted receipt.

The receipts

Each source, the line we quote from it, its date and which way it cuts. Free to read and to cite.

  1. 1Supports the claimbenchlm.ai ↗

    leads the ARC-AGI-2 leaderboard with 92.5%

    Look up an archived copy ↗

  2. 2Contextbenchlm.ai ↗

    Average individual human performance is 66%

    Look up an archived copy ↗

  3. 3Contradicts the claimarcprize.org ↗

    Variant ARC-AGI-1 ARC-AGI-2 ARC-AGI-3 Max 96.5% 92.5% 7.78%

    Look up an archived copy ↗

  4. 4Contextarcprize.org ↗

    High 97.0% 85.4% 2.15% Medium 92.5% 67.1% 1.07% Low 74.5% 42.5% 0.33%

    Look up an archived copy ↗

  5. 5Contextarxiv.org ↗

    Like its predecessors ARC-AGI-1 and 2, ARC-AGI-3 focuses entirely on evaluating fluid adaptive efficiency on novel tasks, while avoiding language and external knowledge

    Look up an archived copy ↗

  6. 6Contradicts the claimarxiv.org ↗

    Our testing shows humans can solve 100% of the environments, in contrast to frontier AI systems which, as of March 2026, score below 1%.

    Look up an archived copy ↗

  7. 7Contextarxiv.org ↗

    We introduce ARC-AGI-3, an interactive benchmark for studying agentic intelligence through novel, abstract, turn-based environments in which agents must explore, infer goals, build internal models of environment dynamics, and plan effective action sequences without explicit instructions.

    Look up an archived copy ↗

Members' extras

What each receipt proves, and what would change our mind.

  • What each receipt above proves, in our words
  • The figures table, each number traced to the receipt that states it
  • The trick behind the claim, explained, with the guide to spotting it
  • What would change our verdict
  • Our call on the record, with its due date

The verdict, the opening and every receipt above stay free. Membership adds our analysis to the evidence file for every checked story.

First membership: 30 days free, then A$89 a year. One introductory trial per customer. Card required; renews annually until cancelled. Cancel before the trial ends to avoid the first charge.