Large Language Models Cannot Self-Correct Reasoning Yet
Large Language Models Cannot Self-Correct Reasoning Yet
Summary
This paper tests 'intrinsic' self-correction, where an LLM revises its own answer with no external feedback. On reasoning tasks, LLMs struggle to self-correct this way, and their performance sometimes gets worse after they try. It is a useful counterweight to self-refinement methods. External feedback such as tests, tools or a verifier is what makes correction reliable.
Draft. License: CC BY 4.0 (this summary). Sources: [S1] arXiv, "Large Language Models Cannot Self-Correct Reasoning Yet" (CC BY 4.0).
When to apply
- Designing agent loops: add an external signal (unit tests, execution results, retrieval, a separate checker) instead of only asking 'are you sure?'.
Paper
- Title: Large Language Models Cannot Self-Correct Reasoning Yet
- Authors: Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xinying Song, Denny Zhou
- arXiv: https://arxiv.org/abs/2310.01798 (first posted 2023-10-03)
- License: CC BY 4.0 (checked on the arXiv abstract page 2026-11-02)
- Read for this note: arXiv abstract page; figures restate the abstract.
Related
- 2303.17651 Self-Refine
- 2304.05128 Self-Debugging
Facts
- id: F1 claim: Intrinsic self-correction means an LLM tries to fix its initial answer using only its own abilities, with no external feedback. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
- id: F2 claim: For reasoning tasks, LLMs struggle to self-correct without external feedback (author-reported). confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
- id: F3 claim: Performance sometimes degrades after self-correction (author-reported). confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
Caveats
- Findings are for reasoning tasks with 2023 models; newer reasoning models may behave differently.
Pointers
- id: P1 answers: Full method, experiments and appendices where: https://arxiv.org/abs/2310.01798 access: free, public web page
Source: https://arxiv.org/abs/2310.01798 · License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted), condensed and paraphrased; sources: Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xinying Song, Denny Zhou, \"Large Language Models Cannot Self-Correct Reasoning Yet\", arXiv:2310.01798 (CC BY 4.0)
Cite this
iinventedlight Library. 2026. "Large Language Models Cannot Self-Correct Reasoning Yet." iinventedlight Library, iil:note:gkjgv5n4, version of 2026-11-02. https://iinventedlight.com/library/reference/arxiv/2310-01798-llms-cannot-self-correct-reasoning-yet/. License: CC-BY-4.0. Summary of https://arxiv.org/abs/2310.01798.
@misc{iil_note_gkjgv5n4,
author = {{iinventedlight Library}},
title = {{Large Language Models Cannot Self-Correct Reasoning Yet}},
howpublished = {iinventedlight Library},
year = {2026},
date = {2026-11-02},
url = {https://iinventedlight.com/library/reference/arxiv/2310-01798-llms-cannot-self-correct-reasoning-yet/},
note = {Permanent ID iil:note:gkjgv5n4. License: CC-BY-4.0. Summary of https://arxiv.org/abs/2310.01798.},
}
For language models and agents: start at /llms.txt. This page in Markdown: /library/reference/arxiv/2310-01798-llms-cannot-self-correct-reasoning-yet.md.