How does "Retrieval-based JOL" work?

Fluency-based JOLs ask "does this feel familiar?" — a question working memory answers with misleading ease. Retrieval-based JOLs ask "can I produce this answer independently?" — which requires accessing long-term memory. By forcing recall before rating, the learner receives a direct sample of the retrieval process that the JOL is supposed to predict, rather than relying on a feeling that is only loosely coupled to recall.

How does "Restudy decision protocol" work?

JOLs influence restudy decisions: learners drop items they rate as learned and spend more time on items they rate as not learned. When JOLs are inaccurate, this allocation is counterproductive — easy, familiar items get over-studied; hard items that generate low JOLs but are still above the retention threshold get abandoned. A defined protocol decouples the restudy decision from fluctuating feelings and ties it to objective performance criteria.

How does "Regression-to-mean awareness in JOLs" work?

JOL accuracy is not uniform across confidence levels — high JOLs are more likely to be overestimates than moderate JOLs, because the same fluency signals that produce high confidence (easy processing, recent exposure) are the ones most likely to inflate actual retention estimates. Knowing that the highest-confidence items are the most suspect allows calibrated discounting that counteracts the systematic bias.

How does "Global vs. local JOL separation" work?

Learners tend to let global mood and session-level experience contaminate item-level JOLs. If a session felt productive, all items receive upward-adjusted JOLs; if it felt difficult, all items are rated lower. This contamination reduces item-level discriminability — the ability to correctly distinguish what is well-encoded from what is not — which is the information restudy decisions depend on.

How does "Encoding variability to reduce JOL inflation" work?

A single deep study session produces a concentrated encoding that feels highly familiar — inflating JOLs. When the same information is encountered across varied contexts (different examples, different formats, different sessions), familiarity from any single encounter is lower, which modestly reduces JOL inflation. More importantly, distributed encoding produces stronger retrieval cues because more contextual associations are formed.

How does "Commitment-forcing before feedback" work?

Seeing the correct answer before making a JOL inflates the judgment by making the answer immediately accessible — the learner feels they would have recalled it, when they would not have. This "hindsight inflation" is a variant of the hindsight bias: knowing the answer makes it feel like it was always known. Committing to both an answer and a confidence rating before feedback preserves the independence of the metacognitive judgment.

Thomas Nelson

What are judgments of learning and how do they cause people to study ineffectively?

The science of metacognitive prediction accuracy and how to improve it

Short answer

Judgments of learning (JOLs) are in-the-moment predictions about how well information will be remembered later. Thomas Nelson’s research showed JOLs are often inaccurate — biased upward by current processing fluency — causing learners to declare items "learned" prematurely and under-study material they will later forget. Delayed JOLs and retrieval-based checks produce more accurate predictions and better study-time allocation.

Every learner makes constant judgments about their own learning: "I’ve got this," "I need to review that," "I’m done with this chapter." Thomas Nelson and colleagues spent decades studying how accurate these judgments are and, more importantly, what makes them wrong. The answer: JOLs are heavily contaminated by how easy the material feels right now, which predicts current accessibility but not future retrieval. The practical consequence is systematic over-study of easy material and under-study of hard material that will be forgotten.

The practices (7)

Why it works

Immediate JOLs are inflated by the residual activation of information in working memory — the item is unusually accessible right after study, producing a high feeling of knowing that does not reflect durable encoding. Nelson and Dunlosky showed that delaying JOLs by even a few minutes — long enough for working memory activation to fade — dramatically improves their accuracy as predictors of later recall. The delay forces the judgment to draw on long-term memory, which is the target the learner actually cares about.

How to do it

1After studying an item or section, do not rate it immediately.
2Study several other items first, or take a brief break, before returning to rate the original.
3Make the rating after at least 3–5 minutes: "How confident am I I will recall this tomorrow?"
4Use the delayed rating to decide whether to restudy now or schedule a later review.

Evidence

RCT / meta-analysis

Nelson and Dunlosky (1991) demonstrated that delayed JOLs predicted later recall substantially better than immediate JOLs — a finding robust enough to be called the "delayed JOL effect."

Honest caveat: The delayed JOL effect is robust in controlled studies but has mostly been demonstrated with paired-associate learning tasks; generalization to complex material is plausible but less directly tested.

— Nelson & Dunlosky (1991), "When people’s judgments of learning (JOLs) are extremely accurate at predicting subsequent recall," Psychological Science

Common mistake: Rating comprehension immediately after reading or hearing information, when the material is still in working memory and artificially accessible, producing a high JOL that will not survive 24 hours.

Go deeper on this practice →

Practice this with IX Coach

Reading about a practice changes nothing on its own. IX Coach turns these into a guided, adaptive routine — discerning where you are in real time and walking the practice with you, session after session.

Start with IX Coach →