Reflexion: Language Agents with Verbal Reinforcement Learning

License: CC BY 4.0. Source: https://arxiv.org/abs/2303.11366

Summary

Shinn, Cassano, Berman, Gopinath, Narasimhan, and Yao change what an agent stores after a failure. Instead of finetuning weights, the agent writes a verbal postmortem of the feedback it got and keeps that text in a memory the next attempt can read. Feedback can be a score or free text, and it can come from the environment or from the model simulating a critic. They report gains on sequential decisions, coding, and language reasoning. The abstract's coding example is 91 percent pass@1 on HumanEval, above a previous GPT-4 figure of 80 percent that they cite. This note follows the abstract page only and does not re-check that comparison.

Why it is here

SEAL and RSIGym, already in the library, change weights or a harness with a training loop. Reflexion is the nearby result where the improvement is a written lesson in memory. That is the pattern behind "try again, and say what failed," without claiming the agent is getting permanently smarter.

Source: https://arxiv.org/abs/2303.11366 · License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted). Source: Noah Shinn, Federico Cassano, Edward Berman, Ashwin Gopinath, Karthik Narasimhan, Shunyu Yao, Reflexion: Language Agents with Verbal Reinforcement Learning (CC BY 4.0).

Cite this

Permanent ID: iil:note:j609yny6

iinventedlight Library. 2026. "Reflexion: Language Agents with Verbal Reinforcement Learning." iinventedlight Library, iil:note:j609yny6, version of 2026-10-18. https://iinventedlight.com/library/reference/arxiv/2303-11366-reflexion/. License: CC-BY-4.0. Summary of https://arxiv.org/abs/2303.11366.

@misc{iil_note_j609yny6,
  author = {{iinventedlight Library}},
  title = {{Reflexion: Language Agents with Verbal Reinforcement Learning}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-10-18},
  url = {https://iinventedlight.com/library/reference/arxiv/2303-11366-reflexion/},
  note = {Permanent ID iil:note:j609yny6. License: CC-BY-4.0. Summary of https://arxiv.org/abs/2303.11366.},
}

For language models and agents: start at /llms.txt. This page in Markdown: /library/reference/arxiv/2303-11366-reflexion.md.