Preprint
Reinforcement Learning

Plan-and-act: Improving planning of agents for long-horizon tasks

Lutfi Eren Erdogan, Nicholas Lee, Sehoon Kim, Suhong Moon, Hiroki Furuta, Gopala Anumanchipalli, Kurt Keutzer, Amir Gholami
January 1, 2025

0

Citations

0

Influential Citations

Venue

2025

Year

Abstract

… We evaluate PLAN-ANDACT using web navigation as a representative long-horizon planning environment, demonstrating a state-of-the-art 57.58% success rate on the WebArena-Lite …

Analysis

Why This Paper Matters

Long-horizon planning remains a critical challenge for autonomous agents, especially in complex environments like web navigation where tasks require multiple steps and adaptation to dynamic feedback. Traditional approaches either rely on reactive policies that lack foresight or separate planning modules that struggle with execution errors. PLAN-AND-ACT addresses this gap by tightly coupling planning and execution, enabling agents to both anticipate future steps and adjust in real time. This is particularly relevant for real-world applications such as automated web testing, digital assistants, and robotic process automation, where reliability over extended sequences is paramount.

The paper's focus on web navigation as a testbed is timely, given the growing interest in AI agents that can interact with websites autonomously. The WebArena-Lite benchmark provides a realistic and challenging evaluation, making the reported 57.58% success rate a meaningful advance. This work signals a shift toward more integrated agent architectures that can handle the complexity of open-ended tasks.

Technical Contributions

  • Hierarchical Planning-Action Loop: PLAN-AND-ACT introduces a two-level architecture where a high-level planner generates subgoals (e.g., "fill in username field") and a low-level actor executes primitive actions (e.g., keystrokes). Crucially, the planner receives feedback from the actor to revise plans when actions fail or unexpected states occur.
  • Plan Refinement Mechanism: Unlike static plans, the system continuously updates its plan based on environmental observations, allowing recovery from errors and adaptation to dynamic content.
  • Integration with Web Navigation: The method is tailored for web environments, leveraging DOM structure and element accessibility to ground plans in actionable steps.

Results

PLAN-AND-ACT achieves a 57.58% success rate on WebArena-Lite, surpassing prior state-of-the-art methods. The paper reports that this represents a substantial improvement over both purely reactive agents and those using separate planning modules, though exact comparisons to baselines are not detailed in the abstract. The benchmark includes diverse tasks such as form filling, search, and multi-step transactions, indicating robust performance across scenarios.

Significance

This work has implications beyond web navigation. The plan-and-act paradigm can be applied to any long-horizon task where agents must balance foresight with reactivity, such as robotics, game playing, and software automation. By demonstrating that integrated planning and execution outperforms decoupled approaches, the paper encourages further research into hierarchical agent architectures. For practitioners, PLAN-AND-ACT offers a practical blueprint for building more reliable autonomous systems.