The 96% accurate deepfake detector is 96% accurate on the deepfakes it was shown. On new ones it is closer to a coin flip.
The lab number is real and useless. Point the same detectors at deepfakes from a generator they were not trained on and accuracy falls toward chance, right as governments start leaning on them.
"Deepfake detectors are about 96% accurate, so the technology can reliably catch synthetic video" [SOURCE ↗]
THE CLAIM. deepfake detectors hit around 96% accuracy, so synthetic video can be caught reliably. Intel's FakeCatcher, marketed at a 96% accuracy rate, is the number everyone quotes. THE CHECK: that figure is a controlled-lab result. The DeepFake-Eval-2024 study found leading commercial detectors around 78% on in-the-wild deepfakes, NIST evaluations put accuracy below 40% when the generator differs from the training software, and the Vector Institute named the pattern the Generalization Illusion, where benchmark scores stay high while real-world detection quietly declines. Real capability, badly oversold.
When someone tells you deepfakes can be caught, they usually reach for one figure: 96%. It comes from Intel, which in its Responsible AI work built FakeCatcher, 'a technology that can detect fake videos with a 96% accuracy rate,' reading the faint blood-flow color changes in real video pixels in mil
🔒 THE FULL AUTOPSY · FREE WITH AN ACCOUNTYou just read the free check. Sign in free, a code by email, no passwords, and the rest unlocks: the evidence trail, the steelman and the rebuttal, all 3 sources with quotes and screenshots, and our on-record call.
Couldn't verify your access — this looks like our error, not yours.