Abstract:Various deep reinforcement learning (DRL) approaches have been applied for robot navigation with promising results. Besides avoiding pedestrians during navigation, a robot can also make sounds to aware nearby pedestrians, which normally results a more effective and safer moving trajectory in a crowded environment. However, it is challenging to train such an interactive navigation policy, i.e., outputs both navigation and interactive actions, in DRL. Generally, an interactive navigation policy needs to avoid collisions with pedestrians while reaching the target, make as few sounds as possible, and be robust to diverse environments while different pedestrians may respond differently to the sounds. In this paper, we propose a DRL based interactive navigation approach to meet above requirements. In specific, we first develop a simulation platform that can model different responses of pedestrians w.r.t. the sounds. Then we introduce a reward function that can effectively result proper interactive actions in diverse environments. At last, we use a PPO based method to train the interactive navigation policy. We evaluate our approach in various crowded pedestrian environments and compare its performance with multiple existing methods. The experimental results show that our approach meets the three requirements and outperforms others. Moreover, we show that the reward function can also be used to extend an existing DRL based navigation approach to learn an interactive navigation policy satisfying the requirements. We also deploy the trained policy on a robot and demonstrate its performance in real-world crowded environments.

Generalization in Deep Reinforcement Learning for Robotic Navigation by Reward Shaping

Predictive Hierarchical Reinforcement Learning for Path-Efficient Mapless Navigation with Moving Target.

On Reward Shaping for Mobile Robot Navigation: A Reinforcement Learning and SLAM Based Approach

Heuristic Dense Reward Shaping for Learning-Based Map-Free Navigation of Industrial Automatic Mobile Robots

Deep reinforcement learning based mapless navigation for industrial AMRs: advancements in generalization via potential risk state augmentation

Sensor-Based Navigation Using Hierarchical Reinforcement Learning

Learning Navigation Policies for Mobile Robots in Deep Reinforcement Learning with Random Network Distillation

End-to-End Navigation Strategy with Deep Reinforcement Learning for Mobile Robots

Learning Reward Function with Matching Network for Mapless Navigation

Learning Complicated Navigation Skills from Limited Experience Via Augmenting Offline Datasets

Improving Generalization in Reinforcement Learning Training Regimes for Social Robot Navigation

A Deep Safe Reinforcement Learning Approach for Mapless Navigation.

Navigation of Mobile Robots Based on Deep Reinforcement Learning: Reward Function Optimization and Knowledge Transfer

Autonomous Learning and Navigation of Mobile Robots Based on Deep Reinforcement Learning

Progress and Challenges in Applying Deep Reinforcement Learning to Intelligent Navigation

Interactive Robot Navigation in Crowded Pedestrian Environments Based on Deep Reinforcement Learning

An Efficient Deep Reinforcement Learning Algorithm for Mapless Navigation with Gap-Guided Switching Strategy

Goal-Driven Autonomous Exploration Through Deep Reinforcement Learning

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Obtaining Robust Control and Navigation Policies for Multi-Robot Navigation via Deep Reinforcement Learning

Learning to Navigate in Indoor Environments: from Memorizing to Reasoning