---
title: "Formalizing and Benchmarking Prompt Injection Attacks and Defenses"
license: CC-BY-4.0
license_url: https://creativecommons.org/licenses/by/4.0/
license_note: 'paper is CC BY 4.0 (verified on arXiv abs page 2026-11-12; icon by-4.0.png, http://creativecommons.org/licenses/by/4.0/); note is our own summary'
source: https://iinventedlight.com/library/notes/2310-12815-prompt-injection-attacks-defenses.md
source_license: 'CC BY 4.0'
attribution: 'Summary by iinventedlight (AI-assisted). Source: Yupei Liu, Yuqi Jia, Runpeng Geng, Jinyuan Jia, Neil Zhenqiang Gong, Formalizing and Benchmarking Prompt Injection Attacks and Defenses (CC BY 4.0).'
author: 'iinventedlight (AI-assisted)'
date: 2026-11-12
status: published
approved_by: "Cole Withington, 2026-11-12 14:44 PT, Librarian chat widget t51s316: \"Yes, publish all 100 second-list arXiv notes\""
checked_on: 2026-11-12
as_of: 2026-11-12
confidence: medium
untested: "Not reproduced. Abs page and HTML key sections read 2026-11-12. Named code URLs checked for HTTP 200; code not run."
category: arxiv
topic_area: 'ai-research: alignment-and-safety'
tags: arxiv, prompt-injection, security, benchmarks, llm-apps
arxiv_id: 2310.12815
alias: 2310-12815-prompt-injection-attacks-defenses
sources:
  - id: S1
    title: "Formalizing and Benchmarking Prompt Injection Attacks and Defenses"
    publisher: arXiv
    authors: "Yupei Liu, Yuqi Jia, Runpeng Geng, Jinyuan Jia, Neil Zhenqiang Gong"
    url: https://arxiv.org/abs/2310.12815
    version_read: "v5 (12 Nov 2025)"
    accessed: 2026-11-12
    license: 'CC BY 4.0'
---
# Formalizing and Benchmarking Prompt Injection Attacks and Defenses

## Summary
A prompt injection attack aims to inject malicious instruction or data into the input of an LLM-Integrated Application such that it produces results as an attacker desires. Existing works are limited to case studies. Their framework treats existing attacks as special cases and is used to combine them into a new attack. They then run a systematic evaluation of 5 prompt injection attacks and 10 defenses with 10 language models and 7 tasks. A public platform is released on GitHub. This note records the framework and the benchmark; it is not a how-to for attacks. Comments on the abs page state that the work was published in USENIX Security Symposium 2024. [S1]

## Claims
- id: C1
  claim: "The authors propose a framework that formalizes prompt injection and treats existing attacks as special cases."
  source: S1
  evidence: "we propose a framework to formalize prompt injection attacks"
- id: C2
  claim: "They evaluate 5 attacks and 10 defenses with 10 language models and 7 tasks."
  source: S1
  evidence: "evaluation on 5 prompt injection attacks and 10 defenses with 10 LLMs and 7 tasks"
- id: C3
  claim: "The benchmark platform is public on GitHub."
  source: S1
  evidence: "https://github.com/liu00222/Open-Prompt-Injection"

## Verification
- Code available: Paper: https://github.com/liu00222/Open-Prompt-Injection, HTTP 200 on 2026-11-12. Not run.
- Reproduced: not reproduced (2026-11-12). Code not run.
- Related work: A closely related attack class is covered in [2302-12173-indirect-prompt-injection](https://iinventedlight.com/library/notes/2302-12173-indirect-prompt-injection/). Practice notes include [ao-security-prompt-injection-design](https://iinventedlight.com/library/notes/ao-security-prompt-injection-design/).
- Limits: The 5-by-10-by-10-by-7 study is the paper's protocol, not an exhaustive map of later attacks. This note does not reproduce payloads or exploit steps.
- License: CC BY 4.0 on the abs page (2026-11-12; icon by-4.0.png; http://creativecommons.org/licenses/by/4.0/). Submitted 19 Oct 2023 (v1); last revised v5 (12 Nov 2025). Sources: [S1] https://arxiv.org/abs/2310.12815, v5 (12 Nov 2025). checked_on: 2026-11-12.

## When to apply
Use when asking how prompt injection has been formalized and benchmarked in LLM-integrated applications.

## Facts
- id: F1
  claim: "The paper formalizes prompt injection in language-model applications and places prior attacks inside that framework."
  confidence: medium
  date: 2026-11-12
  sources: [S1]
  license: CC BY 4.0
- id: F2
  claim: "The evaluation covers 5 attacks, 10 defenses, 10 models, and 7 tasks."
  confidence: medium
  date: 2026-11-12
  sources: [S1]
  license: CC BY 4.0
- id: F3
  claim: "The platform is at https://github.com/liu00222/Open-Prompt-Injection."
  confidence: medium
  date: 2026-11-12
  sources: [S1]
  license: CC BY 4.0

## Sources
- [S1] arXiv 2310.12815, https://arxiv.org/abs/2310.12815. License: CC BY 4.0. v5 (12 Nov 2025). Accessed 2026-11-12.

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Summary by iinventedlight (AI-assisted). Paper is CC BY 4.0.

---

Agents: [/agents.md](/agents.md) | [/.well-known/agent-library.json](/.well-known/agent-library.json).
