JH
Jonathan Haber

Designing the Experiment

Plan a real-world activity that will generate clear evidence for or against the belief.

Key takeaways

  • What it is: Plan a real-world activity that will generate clear evidence for or against the belief.
  • Why it works: An experiment needs a design: what will you do, in what context, for how long, and how will you know what the result means? This design step is not bureaucratic — it prevents the most common failure mode of behavioral experiments, which is running an ambiguous experience and then interpreting the results through the lens of the original belief ("The presentation went okay but they were probably just being polite"). Pre-designing the success and failure criteria forces explicit operationalization before the emotional state of the experiment contaminates interpretation.
  • Evidence: Established clinical or therapeutic practice.
  • Avoid: Designing an experiment where you can’t lose — if every possible outcome can be reinterpreted as confirming the original belief, the experiment won’t change anything.

Why it works

An experiment needs a design: what will you do, in what context, for how long, and how will you know what the result means? This design step is not bureaucratic — it prevents the most common failure mode of behavioral experiments, which is running an ambiguous experience and then interpreting the results through the lens of the original belief ("The presentation went okay but they were probably just being polite"). Pre-designing the success and failure criteria forces explicit operationalization before the emotional state of the experiment contaminates interpretation.

How to do it

  1. 1State the experiment: "I will [specific action] in [specific context] on [specific date]."
  2. 2State what would constitute disconfirmation: "If [X doesn’t happen / Y does happen], my prediction was wrong."
  3. 3State what would constitute confirmation: "If [X happens], my prediction was correct."
  4. 4Anticipate obstacles: "What might make the experiment ambiguous? How will I handle that?"
  5. 5Write the design before running the experiment so interpretation stays honest.

What the evidence says

Clinical practice

Pre-registration of predictions before testing them is the principle underlying scientific experiment design — applied here to personal belief testing. Behavioral experiment design is a standard CBT technique with clinical support within the CBT-BE literature.

Honest caveat: The design phase is embedded in the validated behavioral experiment protocol; it has not been studied as a standalone element.

References
  • — Bennett-Levy et al. (2004), "Oxford Guide to Behavioural Experiments in Cognitive Therapy" — comprehensive clinical treatment

Common mistake

Designing an experiment where you can’t lose — if every possible outcome can be reinterpreted as confirming the original belief, the experiment won’t change anything.

IX Coach walks you through the experiment design template before every behavioral experiment, locking in the success criteria before you run it so results can’t be post-hoc rationalized.

Practice this with IX Coach →

Related practices