SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
Summary
Yang, Jimenez, Wettig, Lieret, Yao, Narasimhan, and Press argue that a language-model agent is a different kind of user from a person, and that it needs an interface built for how it reads and acts, in the way a person uses an IDE for programming. SWE-agent is their system for letting such an agent use a computer on software-engineering tasks. Its agent-computer interface is meant to make it easier to create and edit code files, move through a whole repository, and run tests and other programs. The abstract reports a pass@1 rate of 12.5% on SWE-bench and 87.7% on HumanEvalFix, and it frames both as far exceeding the previous state of the art achieved with non-interactive language models. It also says the design of that interface changes how agents behave and how well they score. The abs page lists no journal. This note follows that abstract page only. It is not a manual for git commit or git push.
When to apply
- The question is how a published agent edits a repository through a computer interface built for the agent, and what the abstract reports on SWE-bench and HumanEvalFix.
- The question is the flags for git commit, or whether a team should use trunk-based or branch-based work. Use the Git documentation, and the separate note on Git workflows, for those.
Costs and limits
- The 12.5% and 87.7% figures are the authors' pass@1 numbers on the abstract. This note does not re-check the PDF tables or the benchmark setup.
- Comments say code, data, and a demo are available at a URL. That URL's license was not checked, so it is not a source here.
Evidence (detail)
- The abs page (v3, 11 Nov 2024) says interface design affects language-model agents, and introduces SWE-agent so an agent can use a computer on software-engineering tasks (Abstract).
- The agent-computer interface, as the abstract describes it, is for creating and editing code files, navigating repositories, and executing tests and other programs (Abstract).
- Scores quoted from the abstract, not from a re-read table: pass@1 of 12.5% on SWE-bench and 87.7% on HumanEvalFix, compared with non-interactive language models (Abstract).
- Dateline: submitted on 6 May 2024 (v1), last revised 11 Nov 2024 (this version, v3). No journal reference on the page.
Facts
- id: F1 claim: SWE-agent gives a language-model agent a custom agent-computer interface for creating and editing code files, navigating a repository, and running tests and other programs. confidence: medium date: 2026-10-18 sources: [S1 Abstract] license: CC BY 4.0
- id: F2 claim: The abstract reports pass@1 of 12.5% on SWE-bench and 87.7% on HumanEvalFix, and frames both as far exceeding the previous state of the art achieved with non-interactive language models. confidence: medium date: 2026-10-18 sources: [S1 Abstract] license: CC BY 4.0
- id: F3 claim: The arXiv abs page shows CC BY 4.0. The dateline says submitted on 6 May 2024 (v1) and last revised on 11 Nov 2024 (v3), with no journal reference. confidence: high date: 2026-10-18 sources: [S1 abs page] license: CC BY 4.0
Related
- 2210.03629 ReAct interleaves a written reason with a tool call. This paper is about the interface the agent uses on a repository.
- 2507.08943 covers trunk-based versus branch-based Git workflows for human teams. This note does not choose a workflow or a push target.
Review notes
- Staging draft. Paraphrase of the arXiv abstract page checked 2026-10-18. The PDF was not re-read.
- License on the abs page: icon by-4.0.png, link text "view license", http://creativecommons.org/licenses/by/4.0/.
- The credit line keeps the venue as arXiv 2024, the year of the first posting. version_read is v3 (11 Nov 2024).
- Fresh-eyes recheck 2026-10-18: the abstract says the scores far exceed the previous state of the art from non-interactive language models. The 12.5% and 87.7% figures, authors, and dates were already on the page. Licence unchanged.
Source: https://arxiv.org/abs/2405.15793 · License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted). Source: John Yang, Carlos E. Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, Ofir Press, \"SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering\" (CC BY 4.0).
Cite this
iinventedlight Library. 2026. "SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering." iinventedlight Library, iil:note:ve38xdda, version of 2026-10-18. https://iinventedlight.com/library/reference/arxiv/2405-15793-swe-agent/. License: CC-BY-4.0. Summary of https://arxiv.org/abs/2405.15793.
@misc{iil_note_ve38xdda,
author = {{iinventedlight Library}},
title = {{SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering}},
howpublished = {iinventedlight Library},
year = {2026},
date = {2026-10-18},
url = {https://iinventedlight.com/library/reference/arxiv/2405-15793-swe-agent/},
note = {Permanent ID iil:note:ve38xdda. License: CC-BY-4.0. Summary of https://arxiv.org/abs/2405.15793.},
}
For language models and agents: start at /llms.txt. This page in Markdown: /library/reference/arxiv/2405-15793-swe-agent.md.