Abstract:Current approaches for learning for planning have yet to achieve competitive performance against classical planners in several domains, and have poor overall performance. In this work, we construct novel graph representations of lifted planning tasks and use the WL algorithm to generate features from them. These features are used with classical machine learning methods which have up to 2 orders of magnitude fewer parameters and train up to 3 orders of magnitude faster than the state-of-the-art deep learning for planning models. Our novel approach, WL-GOOSE, reliably learns heuristics from scratch and outperforms the $h^{\text{FF}}$ heuristic in a fair competition setting. It also outperforms or ties with LAMA on 4 out of 10 domains on coverage and 7 out of 10 domains on plan quality. WL-GOOSE is the first learning for planning model which achieves these feats. Furthermore, we study the connections between our novel WL feature generation method, previous theoretically flavoured learning architectures, and Description Logic Features for planning.

What problem does this paper attempt to address?

The paper aims to address the issues encountered when using deep learning methods to learn planning knowledge in the field of automated planning, particularly the problem of underperformance compared to classical planners. Specifically, the paper addresses the following issues: 1. **Limitations of Deep Learning Methods**: Existing deep learning (DL) planning methods cannot compete with classical planners in multiple domains and face various issues such as the need for tuning numerous hyperparameters, lack of interpretability, and being data and computation resource-intensive. 2. **Improving Learning Efficiency and Quality**: Proposes a new method to generate features and use these features to train traditional machine learning models to overcome the challenges faced by deep learning methods. To address the above issues, the authors propose a new method called WL-GOOSE, which has the following characteristics: - **Graph Representation and Feature Extraction**: Constructs a novel graph representation of planning tasks and uses the Weisfeiler-Leman algorithm to generate graph features. - **Use of Classical Machine Learning Models**: Uses these features to train classical machine learning models such as Support Vector Machines (SVM) and Gaussian Processes (GP), which have fewer parameters and faster training speeds. - **Theoretical Analysis**: Provides a theoretical comparison of the proposed WL-GOOSE method with Graph Neural Network (GNN)-based methods and Description Logic Features (DLF). Through experimental evaluation, the paper demonstrates that the WL-GOOSE method outperforms current state-of-the-art deep learning methods in learning domain-specific heuristic functions and shows higher coverage and plan quality in multiple benchmarks, especially in comparison with classical planners hFF and LAMA. This makes WL-GOOSE the first learning method to surpass the hFF heuristic function in multiple metrics and achieve significant results in comparison with LAMA.

Return to Tradition: Learning Reliable Heuristics with Classical Machine Learning

Graph Learning for Planning: The Story Thus Far and Open Challenges

Learning Domain-Independent Heuristics for Grounded and Lifted Planning

FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models

Learning adaptive planning representations with natural language guidance

WLPlan: Relational Features for Symbolic Planning

Learning whom to trust in navigation: dynamically switching between classical and neural planning

Learning to Plan with Natural Language

Learning to Plan by Updating Natural Language

Representation Learning for Classical Planning from Partially Observed Traces

Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning

Query-Efficient Planning with Language Models

Can Graph Learning Improve Planning in LLM-based Agents?

ReasonPlanner: Enhancing Autonomous Planning in Dynamic Environments with Temporal Knowledge Graphs and LLMs

Learning to reason over scene graphs: a case study of finetuning GPT-2 into a robot language model for grounded task planning

Planning Anything with Rigor: General-Purpose Zero-Shot Planning with LLM-based Formalized Programming

Leveraging Environment Interaction for Automated PDDL Translation and Planning with Large Language Models

Can We Rely on LLM Agents to Draft Long-Horizon Plans? Let's Take TravelPlanner as an Example

SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledge