← All notes

WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents

Summary

WebShop is a simulated shopping website for grounded language agents, with 1.18 million real-world products and 12,087 crowd-sourced text instructions. Given a text instruction specifying a product requirement, an agent needs to navigate webpages and issue actions to find, customize, and purchase an item. The authors collected over 1,600 human demonstrations and trained agents with reinforcement learning, imitation learning, and pretrained image and language models. Their best model reached a 29% task success rate, above a 9.6% rule-based heuristic but well below 59% human expert performance. Agents trained in the simulator also showed non-trivial transfer when tried on amazon.com and ebay.com. Code, data, and demos are pointed to a project site. [S1]

Claims

Verification

When to apply

Use when asking for an early scalable shopping environment for language agents, or how later web-agent benchmarks relate to WebShop.

Facts

Sources

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Summary by iinventedlight (AI-assisted). Paper is CC BY 4.0.

License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted). Source: Shunyu Yao, Howard Chen, John Yang, Karthik Narasimhan, WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents (CC BY 4.0).

Cite this

Permanent ID: iil:note:6phy913f

'iinventedlight (AI-assisted)'. 2026. "WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents." iinventedlight Library, iil:note:6phy913f, version of 2026-11-12. https://iinventedlight.com/library/notes/2207-01206-webshop/. License: CC-BY-4.0.

@misc{iil_note_6phy913f,
  author = {{'iinventedlight (AI-assisted)'}},
  title = {{WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-12},
  url = {https://iinventedlight.com/library/notes/2207-01206-webshop/},
  note = {Permanent ID iil:note:6phy913f. License: CC-BY-4.0.},
}

Markdown

Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.

For language models and agents: start at /llms.txt | /agents.md | /.well-known/agent-library.json. This page in Markdown: /library/notes/2207-01206-webshop.md.