Abstract:We investigate the challenge of task planning for multi-task embodied agents in open-world environments. Two main difficulties are identified: 1) executing plans in an open-world environment (e.g., Minecraft) necessitates accurate and multi-step reasoning due to the long-term nature of tasks, and 2) as vanilla planners do not consider how easy the current agent can achieve a given sub-task when ordering parallel sub-goals within a complicated plan, the resulting plan could be inefficient or even infeasible. To this end, we propose "$\underline{D}$escribe, $\underline{E}$xplain, $\underline{P}$lan and $\underline{S}$elect" ($\textbf{DEPS}$), an interactive planning approach based on Large Language Models (LLMs). DEPS facilitates better error correction on initial LLM-generated $\textit{plan}$ by integrating $\textit{description}$ of the plan execution process and providing self-$\textit{explanation}$ of feedback when encountering failures during the extended planning phases. Furthermore, it includes a goal $\textit{selector}$, which is a trainable module that ranks parallel candidate sub-goals based on the estimated steps of completion, consequently refining the initial plan. Our experiments mark the milestone of the first zero-shot multi-task agent that can robustly accomplish 70+ Minecraft tasks and nearly double the overall performances. Further testing reveals our method's general effectiveness in popularly adopted non-open-ended domains as well (i.e., ALFWorld and tabletop manipulation). The ablation and exploratory studies detail how our design beats the counterparts and provide a promising update on the $\texttt{ObtainDiamond}$ grand challenge with our approach. The code is released at <a class="link-external link-https" href="https://github.com/CraftJarvis/MC-Planner" rel="external noopener nofollow">this https URL</a>.

A Model of Counterplanning with Variable Object Set

Agent-Oriented Planning in Multi-Agent Systems

Game-theoretic Objective Space Planning

Planning with Submodular Objective Functions

Research On Creating Or Destroying Objects Planning

Improving Quality of Counterexamples in Model Checking Via Automated Planning

Planning as Model Checking Tasks

Revealing the Barriers of Language Agents in Planning

Task Planning for Object Rearrangement in Multi-room Environments

Counterexample-guided Planning

Planning Modeling and State Reasoning in Competitive Situation

Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents

Multi-Objective Multi-Agent Planning for Discovering and Tracking Multiple Mobile Objects

Strategic Planning for Network Data Analysis

Coordinated Dynamic Mission Planning Scheme for Intelligent Multi-Agent Systems

A Unified Framework for Planning in Adversarial and Cooperative Environments

Describe, Explain, Plan and Select: Interactive Planning with LLMs Enables Open-World Multi-Task Agents.

Model Checking Approach to Automated Planning

Multi-Agent Path Planning Under Observation Schedule Constraints

The aggregation problem of planning based on platform model