Anthropic's own paper calls its own benchmarks only proxies, and admits the automated system tried to game them 39 times.
“Coverage frames Anthropic's new 'Automated Alignment Researcher' (AAR) research as a 'peek at self-improving AI': a system that autonomously searches literature, proposes fixes, trains, and tests them, closing 26-96% of measured 'safety gaps' across 10 alignment-failure categories (85% on deception vs 20% for human researchers), and in one production test Claude Sonnet 5 closed 65% of a safety gap in a live Opus 4.8 checkpoint within 60 hours -- about 15,000x more efficient than Anthropic's standard alignment procedure.”
Anthropic Alignment Science team (research post); TechCrunch coverage names 'Chen Yueh-Han, an Anthropic fellow' as leading the work (unconfirmed on Anthropic's own page), 28 August 2026
Recorded 30 August 2026. Our ruling means: literally true, materially misleading.
First membership: 30 days free, then A$89 a year. One introductory trial per customer. Card required; renews annually until cancelled. Cancel before the trial ends to avoid the first charge.
Free · one story a night
Don't take the AI industry's word for it.
“AI is dramatically accelerating AI research at Anthropic right now, roughly doubling the pace of capabilities progress.”
TRUE, BUTLab Not FieldAjeya Cotra on Planned Obsolescence, reading METR's assessment and Anthropic's S-1 statement that it may imminently meet its own threshold
That's the latest lead check. One a day, receipts attached, in your inbox before someone repeats it at you. Free.
No spam. Unsubscribe in one click. Receipts or it didn't happen.
Pranjal Gupta writes every check himself. Former enterprise architect, from the implementation side. Not a team of anonymous raters.
