Maintain a belief-tracking log with timestamps
Record your beliefs and confidence levels before evidence arrives, so you can see whether you actually updated.
Key takeaways
- What it is: Record your beliefs and confidence levels before evidence arrives, so you can see whether you actually updated.
- Why it works: Confirmation bias affects not just new information intake but memory: people misremember their prior beliefs to be more consistent with current beliefs, making it feel like they updated when they barely moved. A timestamped written record is the only reliable check: if the written prior belief and the post-evidence belief differ, the difference is real; if they don’t differ, neither did you.
- Evidence: Backed by observational / correlational evidence.
- Avoid: Writing beliefs at a granularity too coarse to detect real updating ("I thought this was likely" → "I think this is likely") — use numbers to capture what words obscure.
Why it works
Confirmation bias affects not just new information intake but memory: people misremember their prior beliefs to be more consistent with current beliefs, making it feel like they updated when they barely moved. A timestamped written record is the only reliable check: if the written prior belief and the post-evidence belief differ, the difference is real; if they don’t differ, neither did you.
How to do it
- 1For any significant belief or prediction, write it down with a date and a confidence level (e.g., 75%).
- 2When relevant evidence arrives, write your new confidence level before reading anyone else’s analysis.
- 3Periodically review old entries and compute your actual update size.
- 4Track whether your updates are systematically small (anchoring/conservatism) or systematically large (overreaction).
What the evidence says
ObservationalMemory for prior beliefs is demonstrably distorted by current beliefs — people reconstruct their past views to be more consistent with what they now believe. Pezzo (2003) and others document this hindsight bias effect, which the written record directly prevents.
Honest caveat: A belief log requires honest recording; if beliefs are recorded post-hoc rather than pre-evidence, it reproduces the bias it was meant to prevent.
- — Fischhoff (1975), hindsight ≠ foresight, Journal of Experimental Psychology: Human Perception and Performance
Common mistake
Writing beliefs at a granularity too coarse to detect real updating ("I thought this was likely" → "I think this is likely") — use numbers to capture what words obscure.
IX Coach logs your stated beliefs with timestamps and resurfaces them when new relevant evidence appears, creating a permanent before-and-after record that cannot be reconstructed retroactively.
Practice this with IX Coach →