---
title: 'AI safety via debate'
license: CC-BY-4.0
license_url: https://creativecommons.org/licenses/by/4.0/
license_note: 'paper is arXiv non-exclusive distribution license (verified on arXiv abs page 2026-11-11); this pointer note is our own words and is CC BY 4.0; we link to the paper rather than reproduce it'
source: https://iinventedlight.com/library/notes/1805-00899-ai-safety-via-debate.md
source_license: 'arXiv non-exclusive distribution license'
attribution: 'Pointer by iinventedlight (AI-assisted). Source: Geoffrey Irving, Paul Christiano, Dario Amodei, AI safety via debate (arXiv non-exclusive distribution license). This note links to the paper rather than reproducing it.'
author: 'iinventedlight (AI-assisted)'
date: 2026-11-11
status: published
approved_by: "Cole Withington, 2026-11-11 20:58 PT, Grok Bot chat widget t1717s7407: \"Publish all 100 including the LLMs Encode Clinical Knowledge note\""
checked_on: 2026-11-11
as_of: 2026-11-11
confidence: medium
untested: 'Pointer note only. Paper not reproduced. Abs page and license checked 2026-11-11.'
category: arxiv
topic_area: 'ai-research: alignment-and-safety'
tags: arxiv, alignment, debate, oversight
arxiv_id: 1805.00899
alias: 1805.00899-ai-safety-via-debate
type: pointer
format: pointer
sources:
  - id: S1
    title: 'AI safety via debate'
    publisher: arXiv
    authors: 'Geoffrey Irving, Paul Christiano, Dario Amodei'
    url: https://arxiv.org/abs/1805.00899
    version_read: 'v2 (22 Oct 2018)'
    accessed: 2026-11-11
    license: 'arXiv non-exclusive distribution license'
---
# AI safety via debate

## Summary
[AI safety via debate](https://arxiv.org/abs/1805.00899) (2018) proposed debate as a scalable-oversight method: two models argue for and against a claim, and a weaker judge uses that argument to recover the better answer. The hope is that the judge does not need to be as capable as the models being overseen.

What it introduced: a debate protocol for oversight, with a theoretical and conceptual argument for why a weaker judge might still reach the truth if the debaters are playing against each other.

What it led to: later multi-agent debate methods in practice, and a continuing thread in scalable-oversight research. Live notes: [ao-handoff-multiagent-debate-and-moa](https://iinventedlight.com/library/notes/ao-handoff-multiagent-debate-and-moa/). See also the weak-to-strong generalization pointer in this batch.

Where to read it: https://arxiv.org/abs/1805.00899 (v2, last revised 22 Oct 2018).

The paper is posted on arXiv under the arXiv non-exclusive distribution license. This note links to it rather than reproducing it. The note itself is CC BY 4.0.

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Pointer by iinventedlight (AI-assisted). Paper license: arXiv non-exclusive distribution; this note links to it and does not reproduce it.

---

Agents: [/agents.md](/agents.md) | [/.well-known/agent-library.json](/.well-known/agent-library.json).