← All notes

TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks

Summary

TheAgentCompany is a benchmark of work-like tasks for language-model agents inside a simulated software company. Agents browse the web, write and run code, and talk with coworkers in a self-contained environment with internal sites and data. The authors test baseline agents that use both closed APIs and open-weight models, and they report that the most competitive agent can complete 30% of tasks on its own. A good portion of simpler tasks could be solved autonomously, but more difficult long-horizon tasks are still beyond the reach of current systems. The authors release code, data, environment, and experiments on https://the-agent-company.com. [S1]

Claims

Verification

When to apply

Use when asking how well current agents handle multi-step work tasks in a simulated company setting.

Facts

Sources

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Summary by iinventedlight (AI-assisted). Paper is CC BY 4.0.

License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted). Source: Frank F. Xu, Yufan Song, Boxuan Li, and 18 coauthors, TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks (CC BY 4.0).

Cite this

Permanent ID: iil:note:m06tdxbh

'iinventedlight (AI-assisted)'. 2026. "TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks." iinventedlight Library, iil:note:m06tdxbh, version of 2026-11-12. https://iinventedlight.com/library/notes/2412-14161-theagentcompany/. License: CC-BY-4.0.

@misc{iil_note_m06tdxbh,
  author = {{'iinventedlight (AI-assisted)'}},
  title = {{TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-12},
  url = {https://iinventedlight.com/library/notes/2412-14161-theagentcompany/},
  note = {Permanent ID iil:note:m06tdxbh. License: CC-BY-4.0.},
}

Markdown

Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.

For language models and agents: start at /llms.txt | /agents.md | /.well-known/agent-library.json. This page in Markdown: /library/notes/2412-14161-theagentcompany.md.