Abstract:State abstraction is an effective technique for planning in robotics environments with continuous states and actions, long task horizons, and sparse feedback. In object-oriented environments, predicates are a particularly useful form of state abstraction because of their compatibility with symbolic planners and their capacity for relational generalization. However, to plan with predicates, the agent must be able to interpret them in continuous environment states (i.e., ground the symbols). Manually programming predicate interpretations can be difficult, so we would instead like to learn them from data. We propose an embodied active learning paradigm where the agent learns predicate interpretations through online interaction with an expert. For example, after taking actions in a block stacking environment, the agent may ask the expert: "Is On(block1, block2) true?" From this experience, the agent learns to plan: it learns neural predicate interpretations, symbolic planning operators, and neural samplers that can be used for bilevel planning. During exploration, the agent plans to learn: it uses its current models to select actions towards generating informative expert queries. We learn predicate interpretations as ensembles of neural networks and use their entropy to measure the informativeness of potential queries. We evaluate this approach in three robotic environments and find that it consistently outperforms six baselines while exhibiting sample efficiency in two key metrics: number of environment interactions, and number of queries to the expert. Code: <a class="link-external link-https" href="https://tinyurl.com/active-predicates" rel="external noopener nofollow">this https URL</a>

Learning Probabilistic Relational Planning Rules.

Learning symbolic models of stochastic domains

Learning STRIPS operators from noisy and incomplete observations

Learning probabilistic relational dynamics for multiple tasks

A Probabilistic Model of Action for Least-Commitment Planning with Information Gather

Learning planning rules in noisy stochastic worlds

INCREMENTAL LEARNING OF PROCEDURAL PLANNING KNOWLEDGE IN CHALLENGING ENVIRONMENTS

From Reals to Logic and Back: Inventing Symbolic Vocabularies, Actions and Models for Planning from Raw Data

Learning Neuro-Symbolic Relational Transition Models for Bilevel Planning

Embodied Active Learning of Relational State Abstractions for Bilevel Planning

Learning Symbolic Operators for Task and Motion Planning

Probabilistic Planning by Probabilistic Programming

Learning Planning Abstractions from Language

Learning model-based planning from scratch

Learning First-Order Symbolic Planning Representations That Are Grounded

Nested Reasoning About Autonomous Agents Using Probabilistic Programs

Learning Policies by Learning Rules

Planning with RL and episodic-memory behavioral priors

Symbolic Manipulation Planning with Discovered Object and Relational Predicates

What Planning Problems Can A Relational Neural Network Solve?

Epistemic Exploration for Generalizable Planning and Learning in Non-Stationary Settings