TRUE, BUTRented Halo
The papers' authors rejected both
So independent researchers handed frontier agents real, unpublished research questions and six days each. The agents did all of the engineering and wrote up the results. The papers' own authors rejected both. One got a Strong Reject.
“AI is starting to build AI: frontier systems are automating meaningful parts of AI research, with Anthropic delegating a growing share of its own development to AI and OpenAI reporting a model that saved researchers several weeks, feeding the view that autonomous AI research is within reach.”
9 receipts3 support2 refute4 context
the acceleration is documented and real. What was missing was any controlled test of the leap from acceleration to autonomy. A Princeton and UK AI Security Institute team built one, a shadow evaluation, where a frontier agent takes on the central open question of a high-quality unpublished paper and the paper's original authors grade the output. They ran it on unpublished NeurIPS 2026 submissions with frontier agents given six days and thousands of dollars of compute each. The agents completed all of the engineering without human help, ran the literature searches, debugged the GPU code, compiled full papers, and could not make substantial progress on the actual research questions. Both papers were unambiguously rejected. The authors catalogued five recurring failure modes, starting with poor judgment about what clears the bar for publishable research. Even Anthropic's post agrees on the ceiling: we are not there yet.
There’s more to this story.
Membership opens the full investigation, the strongest counterargument and what to do with what you’ve learned.
30 days free, then A$89 a year. Payment card required. Cancel before the trial ends to avoid the first charge.
Start free trial →- At sign-up: 30 days free. Payment card required. One introductory trial per customer.
- Your trial ends 30 days after you start. Unless you cancel before then in Account → Manage subscription, we charge A$89 for the first year. It renews automatically at A$89/yr until cancelled.
- You can ask for a full refund within 14 days after any annual payment, renewals included, with no reason needed, by emailing hello@bskiller.com. This voluntary refund does not limit your rights under the Australian Consumer Law.
By starting your trial, you agree to the Terms.
Inferno Tech Pty Ltd t/a BS Killer, ABN 27 647 413 474
Get tomorrow’s check free by email.
Couldn't check your access. That's on us.
The trick has a name
We call it Rented Halo: the achievement is real, the drama around it is borrowed. You'll see it again. Learn to spot it →
