Abstract:We investigate the challenge of task planning for multi-task embodied agents in open-world environments. Two main difficulties are identified: 1) executing plans in an open-world environment (e.g., Minecraft) necessitates accurate and multi-step reasoning due to the long-term nature of tasks, and 2) as vanilla planners do not consider how easy the current agent can achieve a given sub-task when ordering parallel sub-goals within a complicated plan, the resulting plan could be inefficient or even infeasible. To this end, we propose "$\underline{D}$escribe, $\underline{E}$xplain, $\underline{P}$lan and $\underline{S}$elect" ($\textbf{DEPS}$), an interactive planning approach based on Large Language Models (LLMs). DEPS facilitates better error correction on initial LLM-generated $\textit{plan}$ by integrating $\textit{description}$ of the plan execution process and providing self-$\textit{explanation}$ of feedback when encountering failures during the extended planning phases. Furthermore, it includes a goal $\textit{selector}$, which is a trainable module that ranks parallel candidate sub-goals based on the estimated steps of completion, consequently refining the initial plan. Our experiments mark the milestone of the first zero-shot multi-task agent that can robustly accomplish 70+ Minecraft tasks and nearly double the overall performances. Further testing reveals our method's general effectiveness in popularly adopted non-open-ended domains as well (i.e., ALFWorld and tabletop manipulation). The ablation and exploratory studies detail how our design beats the counterparts and provide a promising update on the $\texttt{ObtainDiamond}$ grand challenge with our approach. The code is released at <a class="link-external link-https" href="https://github.com/CraftJarvis/MC-Planner" rel="external noopener nofollow">this https URL</a>.

Towards Autonomous Agents: Adaptive-planning, Reasoning, and Acting in Language Models

AutoAct: Automatic Agent Learning from Scratch for QA Via Self-Planning

Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents

AdaPlanner: Adaptive Planning from Feedback with Language Models

Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models

AUTOACT: Automatic Agent Learning from Scratch via Self-Planning

SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals

From Language Models to Practical Self-Improving Computer Agents

Evaluating Language-Model Agents on Realistic Autonomous Tasks

DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning

Exploring Autonomous Agents through the Lens of Large Language Models: A Review

Adaptive Reasoning and Acting in Medical Language Agents

Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents

Cooperation on the Fly: Exploring Language Agents for Ad Hoc Teamwork in the Avalon Game

Agents: An Open-source Framework for Autonomous Language Agents

Learning to Model the World with Language

Athena: Safe Autonomous Agents with Verbal Contrastive Learning

Self Generated Wargame AI: Double Layer Agent Task Planning Based on Large Language Model

Large Language Models Can Self-Improve At Web Agent Tasks

From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems

Empowering Large Language Model Agents through Action Learning