---
title: "VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks"
license: CC-BY-4.0
license_url: https://creativecommons.org/licenses/by/4.0/
license_note: 'paper is arXiv non-exclusive distribution license (verified on arXiv abs page 2026-11-12); this pointer note is our own words and is CC BY 4.0; we link to the paper rather than reproduce it'
source: https://iinventedlight.com/library/notes/2401-13649-visualwebarena.md
source_license: "arXiv non-exclusive distribution license"
attribution: 'Pointer by iinventedlight (AI-assisted). Source: Jing Yu Koh, Robert Lo, Lawrence Jang, and 7 coauthors, VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks (arXiv non-exclusive distribution license). This note links to the paper rather than reproducing it.'
author: 'iinventedlight (AI-assisted)'
date: 2026-11-12
status: published
approved_by: "Cole Withington, 2026-11-12 14:44 PT, Librarian chat widget t51s316: \"Yes, publish all 100 second-list arXiv notes\""
checked_on: 2026-11-12
as_of: 2026-11-12
confidence: medium
untested: 'Pointer note only. Paper not reproduced. Abs page and license checked 2026-11-12.'
category: arxiv
topic_area: 'ai-research: agents'
tags: arxiv, agents, multimodal, web-agents, visualwebarena
arxiv_id: 2401.13649
alias: 2401-13649-visualwebarena
type: pointer
format: pointer
sources:
  - id: S1
    title: "VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks"
    publisher: arXiv
    authors: "Jing Yu Koh and 9 coauthors (listed on the arXiv abs page)"
    url: https://arxiv.org/abs/2401.13649
    version_read: "v2 (6 Jun 2024)"
    accessed: 2026-11-12
    license: "arXiv non-exclusive distribution license"
---
# VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks

## Summary
[VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks](https://arxiv.org/abs/2401.13649) (2024) extends web-agent evaluation from text-only pages to tasks that need visual information. Most computer interfaces are built for human eyes, so many realistic tasks cannot be solved from HTML or accessibility trees alone.

What it introduced: a benchmark of visually grounded web tasks in which an agent must read image-text inputs, follow natural-language instructions, and act on websites. The authors compare text-only and multimodal agents and document gaps in both: text-only models miss visual cues, and even strong multimodal agents still fail many tasks.

What it led to: a standard multimodal companion to WebArena, used when people ask whether a web agent can handle screenshots, icons, and other visual page structure. Live notes: [2307-13854-webarena](https://iinventedlight.com/library/notes/2307-13854-webarena/). Mind2Web and WebVoyager are pointer notes in this batch; WebShop is a full note in batch F.

Where to read it: https://arxiv.org/abs/2401.13649 (v2, last revised 6 Jun 2024). Accepted to ACL 2024. Project page: https://jykoh.com/vwa.

The paper is posted on arXiv under the arXiv non-exclusive distribution license. This note links to it rather than reproducing it. The note itself is CC BY 4.0.

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Pointer by iinventedlight (AI-assisted). Paper license: arXiv non-exclusive distribution; this note links to it and does not reproduce it.

---

Agents: [/agents.md](/agents.md) | [/.well-known/agent-library.json](/.well-known/agent-library.json).
