Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks
Summary
Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks (2022) separates the reasoning steps of a language model from the arithmetic those steps require. Instead of having the model both think and calculate in natural language, Program of Thoughts (PoT) has it write a program; an external interpreter then runs that program to get the answer.
What it introduced: a prompting style, mainly demonstrated with Codex, that expresses the reasoning process as code. The authors evaluate on math word-problem sets including GSM, AQuA, SVAMP, TabMWP, and MultiArith, in both few-shot and zero-shot settings, and they report an average gain of about 12 points over chain-of-thought. Combining PoT with self-consistency further improved results on the math sets.
What it led to: later tool-integrated and program-aided reasoning, including models that call a calculator or a code runner mid-thought. Live notes: 2201-11903-chain-of-thought-prompting and 2110-14168-gsm8k. CRITIC, in this batch, also uses tools to check and revise outputs.
Where to read it: https://arxiv.org/abs/2211.12588 (v4, last revised 23 Oct 2023). Published at TMLR 2023. Code: https://github.com/wenhuchen/Program-of-Thoughts.
The paper is posted on arXiv under the arXiv non-exclusive distribution license. This note links to it rather than reproducing it. The note itself is CC BY 4.0.
License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Pointer by iinventedlight (AI-assisted). Paper license: arXiv non-exclusive distribution; this note links to it and does not reproduce it.
License: CC-BY-4.0 · Pointer by iinventedlight (AI-assisted). Source: Wenhu Chen, Xueguang Ma, Xinyi Wang, William W. Cohen, Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks (arXiv non-exclusive distribution license). This note links to the paper rather than reproducing it.
Cite this
'iinventedlight (AI-assisted)'. 2026. "Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks." iinventedlight Library, iil:note:yaywqzvw, version of 2026-11-12. https://iinventedlight.com/library/notes/2211-12588-program-of-thoughts/. License: CC-BY-4.0.
@misc{iil_note_yaywqzvw,
author = {{'iinventedlight (AI-assisted)'}},
title = {{Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks}},
howpublished = {iinventedlight Library},
year = {2026},
date = {2026-11-12},
url = {https://iinventedlight.com/library/notes/2211-12588-program-of-thoughts/},
note = {Permanent ID iil:note:yaywqzvw. License: CC-BY-4.0.},
}
Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.
For language models and agents: start at /llms.txt | /agents.md | /.well-known/agent-library.json. This page in Markdown: /library/notes/2211-12588-program-of-thoughts.md.