← Reference notes

Self-Refine: Iterative Refinement with Self-Feedback

Summary

Self-Refine uses one LLM in three roles. It writes a draft, critiques its own draft, and then revises using that critique, repeating the loop. It needs no extra training, training data or reinforcement learning. Across 7 tasks with GPT-3.5, ChatGPT and GPT-4, humans and automatic metrics preferred the refined outputs. Task performance improved by about 20% absolute on average.

Draft. License: CC BY 4.0 (this summary). Sources: [S1] arXiv, "Self-Refine: Iterative Refinement with Self-Feedback" (CC BY 4.0).

When to apply

• Tasks where quality can be judged by reading the output (style, constraints, code readability).
• Cheap to try: only prompts, no training.

Paper

• Title: Self-Refine: Iterative Refinement with Self-Feedback
• Authors: Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, et al.
• arXiv: https://arxiv.org/abs/2303.17651 (first posted 2023-03-30)
• License: CC BY 4.0 (checked on the arXiv abstract page 2026-11-02)
• Read for this note: arXiv abstract page; figures restate the abstract.

Related

• 2310.01798 Large Language Models Cannot Self-Correct Reasoning Yet
• 2303.11366 Reflexion (published)

Facts

• id: F1 claim: Self-Refine uses a single LLM as generator, feedback provider and refiner, looping generate -> feedback -> refine. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F2 claim: It requires no supervised training data, additional training or reinforcement learning. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F3 claim: It was evaluated on 7 diverse tasks, from dialogue response generation to math reasoning, with GPT-3.5, ChatGPT and GPT-4. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F4 claim: Outputs were preferred by humans and automatic metrics over one-step generation, with about 20% absolute average improvement in task performance (author-reported). confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02

Caveats

• Later work (see 2310.01798) found intrinsic self-correction without external feedback can fail or hurt on reasoning tasks; gains depend on the task and on feedback quality.
• Each iteration adds latency and tokens.

Pointers

• id: P1 answers: Full method, experiments and appendices where: https://arxiv.org/abs/2303.17651 access: free, public web page

@misc{iil_note_cdcm2tpk,
  author = {{iinventedlight Library}},
  title = {{Self-Refine: Iterative Refinement with Self-Feedback}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-02},
  url = {https://iinventedlight.com/library/reference/arxiv/2303-17651-self-refine/},
  note = {Permanent ID iil:note:cdcm2tpk. License: CC-BY-4.0. Summary of https://arxiv.org/abs/2303.17651.},
}

For language models and agents: start at /llms.txt. This page in Markdown: /library/reference/arxiv/2303-17651-self-refine.md.