Abstract:Recent learning-to-imitation methods have shown promising results in planning via imitating within the observation-action space. However, their ability in open environments remains constrained, particularly in long-horizon tasks. In contrast, traditional symbolic planning excels in long-horizon tasks through logical reasoning over human-defined symbolic spaces but struggles to handle observations beyond symbolic states, such as high-dimensional visual inputs encountered in real-world scenarios. In this work, we draw inspiration from abductive learning and introduce a novel framework \textbf{AB}ductive \textbf{I}mitation \textbf{L}earning (ABIL) that integrates the benefits of data-driven learning and symbolic-based reasoning, enabling long-horizon planning. Specifically, we employ abductive reasoning to understand the demonstrations in symbolic space and design the principles of sequential consistency to resolve the conflicts between perception and reasoning. ABIL generates predicate candidates to facilitate the perception from raw observations to symbolic space without laborious predicate annotations, providing a groundwork for symbolic planning. With the symbolic understanding, we further develop a policy ensemble whose base policies are built with different logical objectives and managed through symbolic reasoning. Experiments show that our proposal successfully understands the observations with the task-relevant symbolics to assist the imitation learning. Importantly, ABIL demonstrates significantly improved data efficiency and generalization across various long-horizon tasks, highlighting it as a promising solution for long-horizon planning. Project website: \url{<a class="link-external link-https" href="https://www.lamda.nju.edu.cn/shaojj/KDD25_ABIL/" rel="external noopener nofollow">this https URL</a>}.

What Should I Do Now? Marrying Reinforcement Learning and Symbolic Planning

Planning-Augmented Hierarchical Reinforcement Learning

Hierarchical Reinforcement Learning with Abductive Planning

Hierarchical Reinforcement Learning Based on Planning Operators

Hierarchical Planning Through Goal-Conditioned Offline Reinforcement Learning

SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planning

Hierarchies of Planning and Reinforcement Learning for Robot Navigation

Retrieval-Augmented Hierarchical in-Context Reinforcement Learning and Hindsight Modular Reflections for Task Planning with LLMs

HDPlanner: Advancing Autonomous Deployments in Unknown Environments through Hierarchical Decision Networks

Behavior Planning at Urban Intersections through Hierarchical Reinforcement Learning

Learning for Long-Horizon Planning via Neuro-Symbolic Abductive Imitation

Hybrid Recurrent Models Support Emergent Descriptions for Hierarchical Planning and Control

Interactive Hierarchical Guidance using Language

Hierarchical reinforcement learning with natural language subgoals

Deep Reinforcement Learning with Dynamic Graphs for Adaptive Informative Path Planning

Learning adaptive planning representations with natural language guidance

From Semantics to Execution: Integrating Action Planning With Reinforcement Learning for Robotic Causal Problem-Solving

Representation Learning and Reinforcement Learning for Dynamic Complex Motion Planning System

Compositional Foundation Models for Hierarchical Planning

Hierarchical Reinforcement Learning in Complex 3D Environments

Learning Neuro-Symbolic Relational Transition Models for Bilevel Planning