Abstract:Autonomy via agents using large language models (LLMs) for personalized, standardized tasks boosts human efficiency. Automating web tasks (like booking hotels within a budget) is increasingly sought after. Fulfilling practical needs, the web agent also serves as an important proof-of-concept example for various agent grounding scenarios, with its success promising advancements in many future applications. Prior research often handcrafts web agent strategies (e.g., prompting templates, multi-agent systems, search methods, etc.) and the corresponding in-context examples, which may not generalize well across all real-world scenarios. On the other hand, there has been limited study on the misalignment between a web agent's observation/action representation and the pre-training data of the LLM it's based on. This discrepancy is especially notable when LLMs are primarily trained for language completion rather than tasks involving embodied navigation actions and symbolic web elements. Our study enhances an LLM-based web agent by simply refining its observation and action space to better align with the LLM's capabilities. This approach enables our base agent to significantly outperform previous methods on a wide variety of web tasks. Specifically, on WebArena, a benchmark featuring general-purpose web interaction tasks, our agent AgentOccam surpasses the previous state-of-the-art and concurrent work by 9.8 (+29.4%) and 5.9 (+15.8%) absolute points respectively, and boosts the success rate by 26.6 points (+161%) over similar plain web agents with its observation and action space alignment. We achieve this without using in-context examples, new agent roles, online feedback or search strategies. AgentOccam's simple design highlights LLMs' impressive zero-shot performance on web tasks, and underlines the critical role of carefully tuning observation and action spaces for LLM-based agents.

OpenWebAgent: An Open Toolkit to Enable Web Agents on Large Language Models

Large Language Model Powered Agents in the Web

AutoWebGLM: A Large Language Model-based Web Navigating Agent

A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis

OpenAgents: An Open Platform for Language Agents in the Wild

WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models

OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization

Agents: An Open-source Framework for Autonomous Language Agents

AcawebAgent: A Large Language Model-Powered Assistant for Early Academic Research

ModelScope-Agent: Building Your Customizable Agent System with Open-source Large Language Models

ScribeAgent: Towards Specialized Web Agents Using Production-Scale Workflow Data

Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation

Large Language Models Empowered Personalized Web Agents

AgentOccam: A Simple Yet Strong Baseline for LLM-Based Web Agents

WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning

Mind2Web: Towards a Generalist Agent for the Web

Large Language Model-Brained GUI Agents: A Survey

TaskWeaver: A Code-First Agent Framework

Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents

Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence