Abstract:State abstraction is an effective technique for planning in robotics environments with continuous states and actions, long task horizons, and sparse feedback. In object-oriented environments, predicates are a particularly useful form of state abstraction because of their compatibility with symbolic planners and their capacity for relational generalization. However, to plan with predicates, the agent must be able to interpret them in continuous environment states (i.e., ground the symbols). Manually programming predicate interpretations can be difficult, so we would instead like to learn them from data. We propose an embodied active learning paradigm where the agent learns predicate interpretations through online interaction with an expert. For example, after taking actions in a block stacking environment, the agent may ask the expert: "Is On(block1, block2) true?" From this experience, the agent learns to plan: it learns neural predicate interpretations, symbolic planning operators, and neural samplers that can be used for bilevel planning. During exploration, the agent plans to learn: it uses its current models to select actions towards generating informative expert queries. We learn predicate interpretations as ensembles of neural networks and use their entropy to measure the informativeness of potential queries. We evaluate this approach in three robotic environments and find that it consistently outperforms six baselines while exhibiting sample efficiency in two key metrics: number of environment interactions, and number of queries to the expert. Code: <a class="link-external link-https" href="https://tinyurl.com/active-predicates" rel="external noopener nofollow">this https URL</a>

Refining Incomplete Planning Domain Models Through Plan Traces.

Enhancing Temporal Planning Domains by Sequential Macro-actions (Extended Version)

The Role of Macros in Tractable Planning

Building and Refining Abstract Planning Cases by Change of Representation Language

Learning Planning Abstractions from Language

Refining HTN Methods via Task Insertion with Preferences

Learning Abstract World Model for Value-preserving Planning with Options

Discovering Underlying Plans Based on Shallow Models

Partial-Order, Partially-Seen Observations of Fluents or Actions for Plan Recognition as Planning

Minimal Value-Equivalent Partial Models for Scalable and Robust Planning in Lifelong Reinforcement Learning

Joint Verification and Refinement of Language Models for Safety-Constrained Planning

Planning Domain Model Acquisition from State Traces without Action Parameters

Learning to Plan by Updating Natural Language

Representation Learning for Classical Planning from Partially Observed Traces

Closed-Loop Long-Horizon Robotic Planning via Equilibrium Sequence Modeling

Latent Plan Transformer for Trajectory Abstraction: Planning as Latent Space Inference

Synthesizing Customized Planners from Specifications

Learning model-based planning from scratch

Hybrid Search for Efficient Planning with Completeness Guarantees

Refining Diffusion Planner for Reliable Behavior Synthesis by Automatic Detection of Infeasible Plans

Embodied Active Learning of Relational State Abstractions for Bilevel Planning