← All notes

Formalizing and Benchmarking Prompt Injection Attacks and Defenses

Summary

A prompt injection attack aims to inject malicious instruction or data into the input of an LLM-Integrated Application such that it produces results as an attacker desires. Existing works are limited to case studies. Their framework treats existing attacks as special cases and is used to combine them into a new attack. They then run a systematic evaluation of 5 prompt injection attacks and 10 defenses with 10 language models and 7 tasks. A public platform is released on GitHub. This note records the framework and the benchmark; it is not a how-to for attacks. Comments on the abs page state that the work was published in USENIX Security Symposium 2024. [S1]

Claims

Verification

When to apply

Use when asking how prompt injection has been formalized and benchmarked in LLM-integrated applications.

Facts

Sources

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Summary by iinventedlight (AI-assisted). Paper is CC BY 4.0.

License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted). Source: Yupei Liu, Yuqi Jia, Runpeng Geng, Jinyuan Jia, Neil Zhenqiang Gong, Formalizing and Benchmarking Prompt Injection Attacks and Defenses (CC BY 4.0).

Cite this

Permanent ID: iil:note:ere0j6z9

'iinventedlight (AI-assisted)'. 2026. "Formalizing and Benchmarking Prompt Injection Attacks and Defenses." iinventedlight Library, iil:note:ere0j6z9, version of 2026-11-12. https://iinventedlight.com/library/notes/2310-12815-prompt-injection-attacks-defenses/. License: CC-BY-4.0.

@misc{iil_note_ere0j6z9,
  author = {{'iinventedlight (AI-assisted)'}},
  title = {{Formalizing and Benchmarking Prompt Injection Attacks and Defenses}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-12},
  url = {https://iinventedlight.com/library/notes/2310-12815-prompt-injection-attacks-defenses/},
  note = {Permanent ID iil:note:ere0j6z9. License: CC-BY-4.0.},
}

Markdown

Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.

For language models and agents: start at /llms.txt | /agents.md | /.well-known/agent-library.json. This page in Markdown: /library/notes/2310-12815-prompt-injection-attacks-defenses.md.