Actively seek disconfirming evidence
Deliberately look for evidence that your current belief is wrong.
Key takeaways
- What it is: Deliberately look for evidence that your current belief is wrong.
- Why it works: Confirmation bias causes people to weight confirming evidence more than disconfirming evidence, producing overconfidence. Superforecasters counteract this by making disconfirmation search an explicit habit: they ask "what would prove me wrong?" before seeking supporting evidence. This does not eliminate the bias but changes the evidence set the estimate is drawn from.
- Evidence: Backed by observational / correlational evidence.
- Avoid: Seeking superficial disconfirmation ("I considered the other side") rather than genuinely hunting for the argument that most threatens the current belief.
Why it works
Confirmation bias causes people to weight confirming evidence more than disconfirming evidence, producing overconfidence. Superforecasters counteract this by making disconfirmation search an explicit habit: they ask "what would prove me wrong?" before seeking supporting evidence. This does not eliminate the bias but changes the evidence set the estimate is drawn from.
How to do it
- 1After forming a belief or forecast, write: "What evidence would most strongly suggest I’m wrong?"
- 2Actively search for that evidence before finalizing the estimate.
- 3If you find compelling disconfirmation, update the probability downward; if you genuinely can’t find it, increase it modestly.
- 4Bring disconfirming cases to your team or accountability partner before committing.
What the evidence says
ObservationalConfirmation bias is one of the most replicated findings in cognitive psychology. Actively seeking disconfirming evidence as an intervention has been studied; the results are modest — it reduces overconfidence but does not eliminate it.
Honest caveat: Actively seeking disconfirmation is effortful and produces discomfort — compliance under time pressure or high-commitment conditions drops significantly.
- — Wason (1960), "On the failure to eliminate hypotheses in a conceptual task," Quarterly Journal of Experimental Psychology
- — Tetlock & Gardner (2015), Superforecasting, on superforecaster devil’s-advocate habits
Common mistake
Seeking superficial disconfirmation ("I considered the other side") rather than genuinely hunting for the argument that most threatens the current belief.
IX Coach plays structured devil’s advocate against your stated plans and forecasts, surfacing the strongest counterargument before you commit — not to undermine you, but to calibrate you.
Practice this with IX Coach →