← Reference notes

Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection

Summary

Standard RAG always retrieves a fixed number of passages, whether or not they are needed or relevant. Self-RAG trains one LM to decide when to retrieve. It also critiques the passages and its own output using special 'reflection tokens', which makes its behavior controllable at inference. Self-RAG at 7B and 13B parameters outperformed ChatGPT and retrieval-augmented Llama2-chat on open-domain QA, reasoning and fact verification.

Draft. License: CC BY 4.0 (this summary). Sources: [S1] arXiv, "Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection" (CC BY 4.0).

When to apply

• Retrieval systems where retrieval is sometimes unnecessary or noisy.
• Needs training a model; not a prompt-only technique.

Paper

• Title: Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
• Authors: Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, Hannaneh Hajishirzi
• arXiv: https://arxiv.org/abs/2310.11511 (first posted 2023-10-17)
• License: CC BY 4.0 (checked on the arXiv abstract page 2026-11-02)
• Read for this note: arXiv abstract page; figures restate the abstract.

Related

• 2005.11401 RAG (Lewis et al.) is not CC-licensed, so no note was drafted for it

Facts

• id: F1 claim: Self-RAG trains a single LM to retrieve passages on demand rather than always retrieving a fixed number. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F2 claim: The model generates reflection tokens to assess retrieved passages and its own generations. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F3 claim: Reflection tokens make the model controllable at inference time for different task requirements. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F4 claim: Self-RAG (7B and 13B) outperformed ChatGPT and retrieval-augmented Llama2-chat on open-domain QA, reasoning and fact verification, with gains in factuality and citation accuracy for long-form generation (author-reported). confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02

Caveats

• Comparisons are to 2023 models.

Pointers

• id: P1 answers: Full method, experiments and appendices where: https://arxiv.org/abs/2310.11511 access: free, public web page

@misc{iil_note_s67wmq04,
  author = {{iinventedlight Library}},
  title = {{Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-02},
  url = {https://iinventedlight.com/library/reference/arxiv/2310-11511-self-rag/},
  note = {Permanent ID iil:note:s67wmq04. License: CC-BY-4.0. Summary of https://arxiv.org/abs/2310.11511.},
}

For language models and agents: start at /llms.txt. This page in Markdown: /library/reference/arxiv/2310-11511-self-rag.md.