---
title: "Language Models (Mostly) Know What They Know"
license: CC-BY-4.0
license_url: https://creativecommons.org/licenses/by/4.0/
license_note: "arXiv abs page shows a CC BY 4.0 icon (by-4.0.png) and a view-license link to http://creativecommons.org/licenses/by/4.0/, confirmed 2026-10-18. This file is an original summary, not the abstract."
source: https://arxiv.org/abs/2207.05221
source_license: "CC BY 4.0"
attribution: "Summary by iinventedlight (AI-assisted). Source: Saurav Kadavath, Tom Conerly, Amanda Askell, Tom Henighan, Dawn Drain, Ethan Perez, Nicholas Schiefer, Zac Hatfield-Dodds, Nova DasSarma, Eli Tran-Johnson, Scott Johnston, Sheer El-Showk, Andy Jones, Nelson Elhage, Tristan Hume, Anna Chen, Yuntao Bai, Sam Bowman, Stanislav Fort, Deep Ganguli, Danny Hernandez, Josh Jacobson, Jackson Kernion, Shauna Kravec, Liane Lovitt, Kamal Ndousse, Catherine Olsson, Sam Ringer, Dario Amodei, Tom Brown, Jack Clark, Nicholas Joseph, Ben Mann, Sam McCandlish, Chris Olah, Jared Kaplan, Language Models (Mostly) Know What They Know (CC BY 4.0)."
date: 2026-10-18
status: published
category: arxiv
tags: assistants, calibration, oversight
arxiv_id: 2207.05221
checked_on: 2026-10-18
sources:
  - id: S1
    title: "Language Models (Mostly) Know What They Know"
    authors: "Saurav Kadavath, Tom Conerly, Amanda Askell, Tom Henighan, Dawn Drain, Ethan Perez, Nicholas Schiefer, Zac Hatfield-Dodds, Nova DasSarma, Eli Tran-Johnson, Scott Johnston, Sheer El-Showk, Andy Jones, Nelson Elhage, Tristan Hume, Anna Chen, Yuntao Bai, Sam Bowman, Stanislav Fort, Deep Ganguli, Danny Hernandez, Josh Jacobson, Jackson Kernion, Shauna Kravec, Liane Lovitt, Kamal Ndousse, Catherine Olsson, Sam Ringer, Dario Amodei, Tom Brown, Jack Clark, Nicholas Joseph, Ben Mann, Sam McCandlish, Chris Olah, Jared Kaplan"
    url: https://arxiv.org/abs/2207.05221
    accessed: 2026-10-18
    license: CC BY 4.0
    attribution: "Saurav Kadavath, Tom Conerly, Amanda Askell, Tom Henighan, Dawn Drain, Ethan Perez, Nicholas Schiefer, Zac Hatfield-Dodds, Nova DasSarma, Eli Tran-Johnson, Scott Johnston, Sheer El-Showk, Andy Jones, Nelson Elhage, Tristan Hume, Anna Chen, Yuntao Bai, Sam Bowman, Stanislav Fort, Deep Ganguli, Danny Hernandez, Josh Jacobson, Jackson Kernion, Shauna Kravec, Liane Lovitt, Kamal Ndousse, Catherine Olsson, Sam Ringer, Dario Amodei, Tom Brown, Jack Clark, Nicholas Joseph, Ben Mann, Sam McCandlish, Chris Olah, Jared Kaplan, Language Models (Mostly) Know What They Know (CC BY 4.0)."
---
# Language Models (Mostly) Know What They Know

License: [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/). Source: https://arxiv.org/abs/2207.05221

## Summary
Kadavath and coauthors ask whether a model can tell when its own answer is right. On multiple-choice and true-or-false items in a suitable format, larger models were well calibrated. For open-ended answers they have the model propose a reply and then estimate P(True), the chance that reply is correct. That estimate scaled and calibrated reasonably, and it got better if the model saw several of its own samples first. A second target, P(IK), is the chance the model knows the answer before any particular reply is on the table. Models could predict P(IK) and partly transfer across tasks, but calibration on new tasks was weaker. P(IK) rose when the prompt contained a relevant source or a hint on a math word problem. The authors frame this as a step toward models that can say they do not know. This note follows the abstract page only.

## Why it is here
The assistant note says to treat confident answers with skepticism and to ask for sources. This paper is evidence that, in the settings they tested, a model can be asked to score its own claim, and that the score is more meaningful on larger models and when source text is actually in the prompt. It is not a guarantee that a chat product will admit uncertainty.