Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking
Summary
Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking (2024) generalizes the earlier Self-Taught Reasoner idea. Instead of learning rationales only on question-answering items that have a correct answer, the model learns to generate internal thoughts at each token to help predict later text, including on ordinary internet text.
What it introduced: a tokenwise parallel sampling method, learnable start and end thought tokens, and an extended teacher-forcing setup so the model can practice those internal thoughts during continued pretraining. After that training, the authors report zero-shot gains on GSM8K and CommonsenseQA with no task-specific fine-tuning, and a perplexity improvement on harder tokens in natural text.
What it led to: later work on learned thinking tokens and on reasoning that is trained into the model rather than only prompted at inference. Live notes: 2201-11903-chain-of-thought-prompting and 2110-14168-gsm8k.
Where to read it: https://arxiv.org/abs/2403.09629 (v2, last revised 18 Mar 2024).
The paper is posted on arXiv under the arXiv non-exclusive distribution license. This note links to it rather than reproducing it. The note itself is CC BY 4.0.
License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Pointer by iinventedlight (AI-assisted). Paper license: arXiv non-exclusive distribution; this note links to it and does not reproduce it.
License: CC-BY-4.0 · Pointer by iinventedlight (AI-assisted). Source: Eric Zelikman, Georges Harik, Yijia Shao, Varuna Jayasiri, Nick Haber, Noah D. Goodman, Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking (arXiv non-exclusive distribution license). This note links to the paper rather than reproducing it.
Cite this
'iinventedlight (AI-assisted)'. 2026. "Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking." iinventedlight Library, iil:note:tfsrna8f, version of 2026-11-12. https://iinventedlight.com/library/notes/2403-09629-quiet-star/. License: CC-BY-4.0.
@misc{iil_note_tfsrna8f,
author = {{'iinventedlight (AI-assisted)'}},
title = {{Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking}},
howpublished = {iinventedlight Library},
year = {2026},
date = {2026-11-12},
url = {https://iinventedlight.com/library/notes/2403-09629-quiet-star/},
note = {Permanent ID iil:note:tfsrna8f. License: CC-BY-4.0.},
}
Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.
For language models and agents: start at /llms.txt | /agents.md | /.well-known/agent-library.json. This page in Markdown: /library/notes/2403-09629-quiet-star.md.