VERIFIED
True; a coin flip scores 50%
True, and Anthropic says what the summaries skip: a coin flip scores 50%.
“Anthropic says that from a five-minute chat, a Claude agent's ranking of books matched its person's on 61% of pairs, 'surprisingly good for such a short conversation', in Project Swap, a book-trading market run by agents for 201 Anthropic employees.”
25 receipts4 support0 refute21 context
its post reports exactly that, across 188 participants who submitted rankings, and gives the baselines: 50% for random guessing, about 53% for ranking by popularity, about 55% for collaborative filtering. We found nothing in our record contradicting the figure.
The twist
the headline number is the understanding, not the outcome. People ended up with roughly their 5th-ranked book of 10, where the best possible was about their second, and Anthropic says most of that gap came from Claude's imprecise read of their preferences, not from the trading.
There’s more to this story.
Membership opens the full investigation, the strongest counterargument and what to do with what you’ve learned.
30 days free, then A$89 a year. Payment card required. Cancel before the trial ends to avoid the first charge.
Start free trial →- At sign-up: 30 days free. Payment card required. One introductory trial per customer.
- Your trial ends 30 days after you start. Unless you cancel before then in Account → Manage subscription, we charge A$89 for the first year. It renews automatically at A$89/yr until cancelled.
- You can ask for a full refund within 14 days after any annual payment, renewals included, with no reason needed, by emailing hello@bskiller.com. This voluntary refund does not limit your rights under the Australian Consumer Law.
By starting your trial, you agree to the Terms.
Inferno Tech Pty Ltd t/a BS Killer, ABN 27 647 413 474
Get tomorrow’s check free by email.
Couldn't check your access. That's on us.
