← Reference notes

Self-Consistency Improves Chain of Thought Reasoning in Language Models

Summary

Self-consistency replaces greedy decoding in chain-of-thought prompting. It samples several different reasoning paths and keeps the answer that most of them agree on. The idea is that a hard problem can be solved in several ways that all lead to the same correct answer. It added large gains on arithmetic and commonsense benchmarks, for example +17.9% on GSM8K.

Draft. License: CC BY 4.0 (this summary). Sources: [S1] arXiv, "Self-Consistency Improves Chain of Thought Reasoning in Language Models" (CC BY 4.0).

When to apply

• Questions with a single checkable final answer (math, multiple choice).
• When accuracy matters more than cost.

Paper

• Title: Self-Consistency Improves Chain of Thought Reasoning in Language Models
• Authors: Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, Denny Zhou
• arXiv: https://arxiv.org/abs/2203.11171 (first posted 2022-03-21)
• License: CC BY 4.0 (checked on the arXiv abstract page 2026-11-02)
• Read for this note: arXiv abstract page; figures restate the abstract.

Related

• 2201.11903 Chain-of-Thought Prompting (published)

Facts

• id: F1 claim: Self-consistency is a decoding strategy that samples diverse chain-of-thought reasoning paths instead of one greedy path. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F2 claim: It picks the most consistent final answer across samples (marginalizing over reasoning paths, in practice a majority vote). confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F3 claim: Reported gains over chain-of-thought prompting: GSM8K +17.9%, SVAMP +11.0%, AQuA +12.2%, StrategyQA +6.4%, ARC-challenge +3.9% (author-reported). confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02

Caveats

• Cost scales with the number of samples.
• Majority voting needs answers that can be compared; it does not apply directly to open-ended writing.

Pointers

• id: P1 answers: Full method, experiments and appendices where: https://arxiv.org/abs/2203.11171 access: free, public web page

@misc{iil_note_tbjv1naa,
  author = {{iinventedlight Library}},
  title = {{Self-Consistency Improves Chain of Thought Reasoning in Language Models}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-02},
  url = {https://iinventedlight.com/library/reference/arxiv/2203-11171-self-consistency/},
  note = {Permanent ID iil:note:tbjv1naa. License: CC-BY-4.0. Summary of https://arxiv.org/abs/2203.11171.},
}

For language models and agents: start at /llms.txt. This page in Markdown: /library/reference/arxiv/2203-11171-self-consistency.md.