Abstract:When deploying mobile robots in real‐world scenarios, such as airports, train stations, hospitals, and schools, collisions with pedestrians are intolerable and catastrophic. Motion safety becomes one of the most fundamental requirements for mobile robots. However, until now, efficient and safe robot navigation in such dynamic environments is still an open problem. The critical reason is that the inconsistency between navigation efficiency and motion safety is greatly intensified by the high dynamics and uncertainties of pedestrians. To face the challenge, this paper proposes a safe deep reinforcement learning algorithm named Conflict‐Averse Safe Reinforcement Learning (CASRL) for autonomous robot navigation in dynamic environments. Specifically, it first separates the collision avoidance sub‐task from the overall navigation task and maintains a safety critic to evaluate the safety/risk of actions. Later, it constructs two task‐specific but model‐agnostic policy gradients for goal‐reaching and collision avoidance sub‐tasks to eliminate their mutual interference. Then, it further performs a conflict‐averse gradient manipulation to address the inconsistency between two sub‐tasks. Finally, extensive experiments are performed to evaluate the superiority of CASRL. Simulation results show an average 8.2% performance improvement over the vanilla baseline in eight groups of dynamic environments, which is further extended to 13.4% in the most challenging group. Besides, forty real‐world experiments fully illustrated that the CASRL could be successfully deployed on a real robot.

IDSI-SO: A Multiagent Safe Reinforcement Learning Navigation Based on Threat Assessment in Complex Dynamic Environments

Learning Observation-Based Certifiable Safe Policy for Decentralized Multi-Robot Navigation

SRL-ORCA: A Socially Aware Multi-Agent Mapless Navigation Algorithm In Complex Dynamic Scenes

SoNIC: Safe Social Navigation with Adaptive Conformal Inference and Constrained Reinforcement Learning

A safe reinforcement learning approach for autonomous navigation of mobile robots in dynamic environments

R-SARL: Crowd-aware Navigation Based Deep Reinforcement Learning for Nonholonomic Robot in Complex Environments

Efficient Multi-agent Cooperative Navigation in Unknown Environments with Interlaced Deep Reinforcement Learning.

SafeCrowdNav: safety evaluation of robot crowd navigation in complex scenes

Learning to Socially Navigate in Pedestrian-rich Environments with Interaction Capacity

Socially Compliant Robot Navigation in Crowded Environment by Human Behavior Resemblance Using Deep Reinforcement Learning

Multi-Robot Cooperative Socially-Aware Navigation Using Multi-Agent Reinforcement Learning

Danger-aware Adaptive Composition of DRL Agents for Self-navigation

Hierarchical and Stable Multiagent Reinforcement Learning for Cooperative Navigation Control

XAI-N: Sensor-based Robot Navigation using Expert Policies and Decision Trees

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Deep reinforcement learning based mapless navigation for industrial AMRs: advancements in generalization via potential risk state augmentation

Enhancing Navigational Safety in Crowded Environments using Semantic-Deep-Reinforcement-Learning-based Navigation

Safe Multi-Agent Reinforcement Learning for Behavior-Based Cooperative Navigation

Multi-Objective Crowd-Aware Robot Navigation System Using Deep Reinforcement Learning

Intelligent mobile robot navigation in unknown and complex environment using reinforcement learning technique

Learning Safety-Aware Policy with Imitation Learning for Context-Adaptive Navigation