Abstract:There is a growing interest in applying pre-trained large language models (LLMs) to planning problems. However, methods that use LLMs directly as planners are currently impractical due to several factors, including limited correctness of plans, strong reliance on feedback from interactions with simulators or even the actual environment, and the inefficiency in utilizing human feedback. In this work, we introduce a novel alternative paradigm that constructs an explicit world (domain) model in planning domain definition language (PDDL) and then uses it to plan with sound domain-independent planners. To address the fact that LLMs may not generate a fully functional PDDL model initially, we employ LLMs as an interface between PDDL and sources of corrective feedback, such as PDDL validators and humans. For users who lack a background in PDDL, we show that LLMs can translate PDDL into natural language and effectively encode corrective feedback back to the underlying domain model. Our framework not only enjoys the correctness guarantee offered by the external planners but also reduces human involvement by allowing users to correct domain models at the beginning, rather than inspecting and correcting (through interactive prompting) every generated plan as in previous work. On two IPC domains and a Household domain that is more complicated than commonly used benchmarks such as ALFWorld, we demonstrate that GPT-4 can be leveraged to produce high-quality PDDL models for over 40 actions, and the corrected PDDL models are then used to successfully solve 48 challenging planning tasks. Resources including the source code will be released at: https://guansuns.github.io/pages/llm-dm.

Large Language Models as Planning Domain Generators

Understanding the Capabilities of Large Language Models for Automated Planning

Exploring and Benchmarking the Planning Capabilities of Large Language Models

Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning

On the Limit of Language Models as Planning Formalizers

On the Planning Abilities of Large Language Models : A Critical Investigation

LASP: Surveying the State-of-the-Art in Large Language Model-Assisted AI Planning

Leveraging Environment Interaction for Automated PDDL Translation and Planning with Large Language Models

Generating consistent PDDL domains with Large Language Models

LLM+P: Empowering Large Language Models with Optimal Planning Proficiency

On the Planning Abilities of Large Language Models (A Critical Investigation with a Proposed Benchmark)

Large Language Models as Commonsense Knowledge for Large-Scale Task Planning

Query-Efficient Planning with Language Models

Translating Natural Language to Planning Goals with Large-Language Models

Generalized Planning in PDDL Domains with Pretrained Large Language Models

On the Prospects of Incorporating Large Language Models (LLMs) in Automated Planning and Scheduling (APS)

Planning in the Dark: LLM-Symbolic Planning Pipeline without Experts

TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usage

Self-planning Code Generation with Large Language Models