Abstract:Navigation of terrestrial robots is typically addressed either with localization and mapping (SLAM) followed by classical planning on the dynamically created maps, or by machine learning (ML), often through end-to-end training with reinforcement learning (RL) or imitation learning (IL). Recently, modular designs have achieved promising results, and hybrid algorithms that combine ML with classical planning have been proposed. Existing methods implement these combinations with hand-crafted functions, which cannot fully exploit the complementary nature of the policies and the complex regularities between scene structure and planning performance. Our work builds on the hypothesis that the strengths and weaknesses of neural planners and classical planners follow some regularities, which can be learned from training data, in particular from interactions. This is grounded on the assumption that, both, trained planners and the mapping algorithms underlying classical planning are subject to failure cases depending on the semantics of the scene and that this dependence is learnable: for instance, certain areas, objects or scene structures can be reconstructed easier than others. We propose a hierarchical method composed of a high-level planner dynamically switching between a classical and a neural planner. We fully train all neural policies in simulation and evaluate the method in both simulation and real experiments with a LoCoBot robot, showing significant gains in performance, in particular in the real environment. We also qualitatively conjecture on the nature of data regularities exploited by the high-level planner.

Plan-Space State Embeddings for Improved Reinforcement Learning

Jointly-Learned State-Action Embedding for Efficient Reinforcement Learning

DCT: Dual Channel Training of Action Embeddings for Reinforcement Learning with Large Discrete Action Spaces

Decoupling feature extraction from policy learning: assessing benefits of state representation learning in goal based robotics

Dynamics-aware Embeddings

A Data-Efficient Framework for Training and Sim-to-Real Transfer of Navigation Policies

Unsupervised Visuomotor Control through Distributional Planning Networks

Bridging the gap between Learning-to-plan, Motion Primitives and Safe Reinforcement Learning

Trajectory Planning with Deep Reinforcement Learning in High-Level Action Spaces

Classical Planning in Deep Latent Space: Bridging the Subsymbolic-Symbolic Boundary

Learning Action Representations for Reinforcement Learning

State Representations as Incentives for Reinforcement Learning Agents: A Sim2Real Analysis on Robotic Grasping

Reinforcement Learning with Function-Valued Action Spaces for Partial Differential Equation Control

Hybrid of representation learning and reinforcement learning for dynamic and complex robotic motion planning

Learning whom to trust in navigation: dynamically switching between classical and neural planning

Learning to Explore using Active Neural SLAM

Planning-Augmented Hierarchical Reinforcement Learning

Decentralized Motion Planning for Multi-Robot Navigation using Deep Reinforcement Learning

Hierarchies of Planning and Reinforcement Learning for Robot Navigation

Robot Motion Planning in Learned Latent Spaces

Learn to Navigate Autonomously Through Deep Reinforcement Learning