Apply the same evidence standard regardless of whether you like the conclusion
Grade the evidence before you know which conclusion it supports.
Key takeaways
- What it is: Grade the evidence before you know which conclusion it supports.
- Why it works: One of Kunda’s clearest findings is asymmetric evidence evaluation: people demand high-quality evidence for unwelcome conclusions and accept weaker evidence for welcome ones. Applying a consistent quality standard — ideally assessing the evidence before mapping it to a conclusion — removes this asymmetry. The mechanism is simple: you cannot selectively accept weak evidence for your favored conclusion if you rated that evidence quality before checking which side it lands on.
- Evidence: Backed by observational / correlational evidence.
- Avoid: Applying the standard retrospectively after the conclusion is already emotionally registered, at which point the standard itself is motivated.
Why it works
One of Kunda’s clearest findings is asymmetric evidence evaluation: people demand high-quality evidence for unwelcome conclusions and accept weaker evidence for welcome ones. Applying a consistent quality standard — ideally assessing the evidence before mapping it to a conclusion — removes this asymmetry. The mechanism is simple: you cannot selectively accept weak evidence for your favored conclusion if you rated that evidence quality before checking which side it lands on.
How to do it
- 1When evaluating sources or arguments, rate their quality before you check which conclusion they support.
- 2Ask: "How would I rate this study/argument if I did not know which conclusion it led to?"
- 3Apply the same criteria — sample size, methodology, publication quality — symmetrically to evidence on both sides.
What the evidence says
ObservationalDifferential evidence standards are a well-documented feature of motivated reasoning. Blind review procedures in science (evaluating methodology before knowing results) demonstrate that consistent standards improve objectivity.
Honest caveat: Pre-evaluating evidence quality before knowing the conclusion is easier to describe than to execute; in practice, the conclusion is often implied by the source or framing.
- — Kunda (1990), Psychological Bulletin — differential scrutiny as a motivated reasoning mechanism
Common mistake
Applying the standard retrospectively after the conclusion is already emotionally registered, at which point the standard itself is motivated.
IX Coach presents evidence and asks you to rate its quality and relevance before revealing which conclusion it most supports, training the consistent-standards habit as a practiced skill.
Practice this with IX Coach →