A new blind benchmark handed seven of them a paper's reference list, scrubbed of anything they could have memorized, and asked for the paper's core idea. They got it 3 to 15 percent of the time.
“Frontier AI models can do genuine scientific reasoning and generate real research ideas, the capability labs increasingly market as AI accelerating science.”
The 'AI as scientific research partner' narrative (frontier labs, August 2026), tested by the Reconstruction benchmark
Recorded 20 August 2026. Our ruling means: literally true, materially misleading.
Cross-model review plus tournament selection raises Match rates to approx. 23-42% across all six domains, which is an observed approx. 2.4x lift over the best single-model baseline.
First membership: 30 days free, then A$89 a year. One introductory trial per customer. Card required; renews annually until cancelled. Cancel before the trial ends to avoid the first charge.
Free · one story a night
Don't take the AI industry's word for it.
“AI is dramatically accelerating AI research at Anthropic right now, roughly doubling the pace of capabilities progress.”
TRUE, BUTLab Not FieldAjeya Cotra on Planned Obsolescence, reading METR's assessment and Anthropic's S-1 statement that it may imminently meet its own threshold
That's the latest lead check. One a day, receipts attached, in your inbox before someone repeats it at you. Free.
No spam. Unsubscribe in one click. Receipts or it didn't happen.
Pranjal Gupta writes every check himself. Former enterprise architect, from the implementation side. Not a team of anonymous raters.
