---
title: "Reflexion: Language Agents with Verbal Reinforcement Learning"
license: CC-BY-4.0
license_url: https://creativecommons.org/licenses/by/4.0/
license_note: "arXiv abs page shows a CC BY 4.0 icon (by-4.0.png) and a view-license link to http://creativecommons.org/licenses/by/4.0/, confirmed 2026-10-18. This file is an original summary, not the abstract."
source: https://arxiv.org/abs/2303.11366
source_license: "CC BY 4.0"
attribution: "Summary by iinventedlight (AI-assisted). Source: Noah Shinn, Federico Cassano, Edward Berman, Ashwin Gopinath, Karthik Narasimhan, Shunyu Yao, Reflexion: Language Agents with Verbal Reinforcement Learning (CC BY 4.0)."
date: 2026-10-18
status: published
category: arxiv
tags: agents, self-improvement, coding
arxiv_id: 2303.11366
checked_on: 2026-10-18
sources:
  - id: S1
    title: "Reflexion: Language Agents with Verbal Reinforcement Learning"
    authors: "Noah Shinn, Federico Cassano, Edward Berman, Ashwin Gopinath, Karthik Narasimhan, Shunyu Yao"
    url: https://arxiv.org/abs/2303.11366
    accessed: 2026-10-18
    license: CC BY 4.0
    attribution: "Noah Shinn, Federico Cassano, Edward Berman, Ashwin Gopinath, Karthik Narasimhan, Shunyu Yao, Reflexion: Language Agents with Verbal Reinforcement Learning (CC BY 4.0)."
---
# Reflexion: Language Agents with Verbal Reinforcement Learning

License: [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/). Source: https://arxiv.org/abs/2303.11366

## Summary
Shinn, Cassano, Berman, Gopinath, Narasimhan, and Yao change what an agent stores after a failure. Instead of finetuning weights, the agent writes a verbal postmortem of the feedback it got and keeps that text in a memory the next attempt can read. Feedback can be a score or free text, and it can come from the environment or from the model simulating a critic. They report gains on sequential decisions, coding, and language reasoning. The abstract's coding example is 91 percent pass@1 on HumanEval, above a previous GPT-4 figure of 80 percent that they cite. This note follows the abstract page only and does not re-check that comparison.

## Why it is here
SEAL and RSIGym, already in the library, change weights or a harness with a training loop. Reflexion is the nearby result where the improvement is a written lesson in memory. That is the pattern behind "try again, and say what failed," without claiming the agent is getting permanently smarter.