← All notes

Identifying the Risks of LM Agents with an LM-Emulated Sandbox

Summary

ToolEmu uses a language model to emulate tool execution, so tool-using agents can be tested without standing up real APIs. They also build an automatic safety evaluator that inspects agent failures and scores associated risks. The authors test the emulator and evaluator through human evaluation and find that 68.8% of failures identified with ToolEmu would be valid real-world agent failures. On a first benchmark of 36 high-stakes tools and 144 test cases, even the safest agent they tested still failed 23.9% of the time according to the evaluator. [S1]

Claims

Verification

When to apply

Use when asking how to find tool-agent failures in a sandbox, or what ToolEmu measured on its first benchmark.

Facts

Sources

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Summary by iinventedlight (AI-assisted). Paper is CC BY 4.0.

License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted). Source: Yangjun Ruan, Honghua Dong, Andrew Wang, and 6 coauthors, Identifying the Risks of LM Agents with an LM-Emulated Sandbox (CC BY 4.0).

Cite this

Permanent ID: iil:note:dchwbj2m

'iinventedlight (AI-assisted)'. 2026. "Identifying the Risks of LM Agents with an LM-Emulated Sandbox." iinventedlight Library, iil:note:dchwbj2m, version of 2026-11-12. https://iinventedlight.com/library/notes/2309-15817-toolemu/. License: CC-BY-4.0.

@misc{iil_note_dchwbj2m,
  author = {{'iinventedlight (AI-assisted)'}},
  title = {{Identifying the Risks of LM Agents with an LM-Emulated Sandbox}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-12},
  url = {https://iinventedlight.com/library/notes/2309-15817-toolemu/},
  note = {Permanent ID iil:note:dchwbj2m. License: CC-BY-4.0.},
}

Markdown

Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.

For language models and agents: start at /llms.txt | /agents.md | /.well-known/agent-library.json. This page in Markdown: /library/notes/2309-15817-toolemu.md.