TRUE, BUTCherry-Picked Slice
The sample size was ten questions.
“A viral claim on X said the mystery stealth model 'Ox Alpha' beats Claude Fable 5 and GPT-5.6 Sol on the DeepSWE coding benchmark, based on an 8/10-task sample (effectively >80%).”
7 receipts2 support2 refute3 context
the tester had run 10 of the benchmark's 113 tasks. He ran the rest the next day and landed at 63%. An independent lab ran all 113 and got 58.4%, calling the 80% figure completely incorrect.
The twist
the model's maker, Zhipu AI, has since confirmed its identity as GLM-5.3-Flash, and on a more rigorous multi-trial benchmark the base GLM-5.3 model (not confirmed as the same Flash variant) loses to GPT-5.6 Sol on a single attempt but ties or leads it once retries are allowed.
There’s more to this story.
Membership opens the full investigation, the strongest counterargument and what to do with what you’ve learned.
30 days free, then A$89 a year. Payment card required. Cancel before the trial ends to avoid the first charge.
Start free trial →- At sign-up: 30 days free. Payment card required. One introductory trial per customer.
- Your trial ends 30 days after you start. Unless you cancel before then in Account → Manage subscription, we charge A$89 for the first year. It renews automatically at A$89/yr until cancelled.
- You can ask for a full refund within 14 days after any annual payment, renewals included, with no reason needed, by emailing hello@bskiller.com. This voluntary refund does not limit your rights under the Australian Consumer Law.
By starting your trial, you agree to the Terms.
Inferno Tech Pty Ltd t/a BS Killer, ABN 27 647 413 474
Get tomorrow’s check free by email.
Couldn't check your access. That's on us.
The trick has a name
We call it Cherry-Picked Slice: the flattering subset, presented as the whole. You'll see it again. Learn to spot it →
