Abstract:When deploying mobile robots in real‐world scenarios, such as airports, train stations, hospitals, and schools, collisions with pedestrians are intolerable and catastrophic. Motion safety becomes one of the most fundamental requirements for mobile robots. However, until now, efficient and safe robot navigation in such dynamic environments is still an open problem. The critical reason is that the inconsistency between navigation efficiency and motion safety is greatly intensified by the high dynamics and uncertainties of pedestrians. To face the challenge, this paper proposes a safe deep reinforcement learning algorithm named Conflict‐Averse Safe Reinforcement Learning (CASRL) for autonomous robot navigation in dynamic environments. Specifically, it first separates the collision avoidance sub‐task from the overall navigation task and maintains a safety critic to evaluate the safety/risk of actions. Later, it constructs two task‐specific but model‐agnostic policy gradients for goal‐reaching and collision avoidance sub‐tasks to eliminate their mutual interference. Then, it further performs a conflict‐averse gradient manipulation to address the inconsistency between two sub‐tasks. Finally, extensive experiments are performed to evaluate the superiority of CASRL. Simulation results show an average 8.2% performance improvement over the vanilla baseline in eight groups of dynamic environments, which is further extended to 13.4% in the most challenging group. Besides, forty real‐world experiments fully illustrated that the CASRL could be successfully deployed on a real robot.

A Behavior-Based Mobile Robot Navigation Method with Deep Reinforcement Learning

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation

Deep Reinforcement Learning Based Mobile Robot Navigation Using Sensor Fusion

End-to-End Navigation Strategy with Deep Reinforcement Learning for Mobile Robots

Robot Navigation with Map-Based Deep Reinforcement Learning

Real-Time Navigation For A Mobile Robot Based On The Autonomous Behavior Agent

A Brief Survey: Deep Reinforcement Learning in Mobile Robot Navigation

Map-less End-to-end Navigation of Mobile Robots Via Deep Reinforcement Learning

Navigation for Mobile Robots Using Reinforcement Learning and Fuzzy Logic

Mobile robot navigation based on Deep Reinforcement Learning: A brief review

Navigation of Mobile Robots Based on Deep Reinforcement Learning: Reward Function Optimization and Knowledge Transfer

Deep-Reinforcement-Learning-Based Semantic Navigation of Mobile Robots in Dynamic Environments

Visual Navigation of Mobile Robots in Complex Environments Based on Distributed Deep Reinforcement Learning

Target-driven multi-input mapless robot navigation with deep reinforcement learning

Deep Reinforcement Learning with Enhanced PPO for Safe Mobile Robot Navigation

A safe reinforcement learning approach for autonomous navigation of mobile robots in dynamic environments

Efficient Reinforcement Learning for 3D LiDAR Navigation of Mobile Robot

Robot Mapless Navigation in VUCA Environments Via Deep Reinforcement Learning

Robot Navigation with Entity-Based Collision Avoidance using Deep Reinforcement Learning