Abstract:In this paper, we present a decentralized sensor-level collision avoidance policy for multi-robot systems, which shows promising results in practical applications. In particular, our policy directly maps raw sensor measurements to an agent's steering commands in terms of the movement velocity. As a first step toward reducing the performance gap between decentralized and centralized methods, we present a multi-scenario multi-stage training framework to learn an optimal policy. The policy is trained over a large number of robots in rich, complex environments simultaneously using a policy gradient based reinforcement learning algorithm. The learning algorithm is also integrated into a hybrid control framework to further improve the policy's robustness and effectiveness. We validate the learned sensor-level collision avoidance policy in a variety of simulated and real-world scenarios with thorough performance evaluations for large-scale multi-robot systems. The generalization of the learned policy is verified in a set of unseen scenarios including the navigation of a group of heterogeneous robots and a large-scale scenario with 100 robots. Although the policy is trained using simulation data only, we have successfully deployed it on physical robots with shapes and dynamics characteristics that are different from the simulated agents, in order to demonstrate the controller's robustness against the sim-to-real modeling error. Finally, we show that the collision-avoidance policy learned from multi-robot navigation tasks provides an excellent solution to the safe and effective autonomous navigation for a single robot working in a dense real human crowd. Our learned policy enables a robot to make effective progress in a crowd without getting stuck. Videos are available at <a class="link-external link-https" href="https://sites.google.com/view/hybridmrca" rel="external noopener nofollow">this https URL</a>

Safe and Efficient Multi-Agent Collision Avoidance with Physics-Informed Reinforcement Learning

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Efficient Multi-agent Navigation with Lightweight DRL Policy

Learning Adaptive Safety for Multi-Agent Systems

Reciprocal Collision Avoidance for General Nonlinear Agents using Reinforcement Learning

Least-Restrictive Multi-Agent Collision Avoidance via Deep Meta Reinforcement Learning and Optimal Control

Relative Distributed Formation and Obstacle Avoidance with Multi-agent Reinforcement Learning

Fully Distributed Multi-Robot Collision Avoidance via Deep Reinforcement Learning for Safe and Efficient Navigation in Complex Scenarios

Obstacle Avoidance in Multi-Agent Formation Process Based on Deep Reinforcement Learning

A Dynamic Safety Shield for Safe and Efficient Reinforcement Learning of Navigation Tasks

Reinforcement learning for multi-agent formation navigation with scalability

A Contact-Safe Reinforcement Learning Framework for Contact-Rich Robot Manipulation

SAFER: Safe Collision Avoidance using Focused and Efficient Trajectory Search with Reinforcement Learning

Collision Avoidance Among Dense Heterogeneous Agents Using Deep Reinforcement Learning

A safe reinforcement learning approach for autonomous navigation of mobile robots in dynamic environments

Collision-Free Path Planning for Multiple Drones Based on Safe Reinforcement Learning

A Multi-Agent Reinforcement Learning Approach For Safe and Efficient Behavior Planning Of Connected Autonomous Vehicles

Hybrid Centralized Training and Decentralized Execution Reinforcement Learning in Multi-Agent Path-Finding Simulations

Physics-Informed Multi-Agent Reinforcement Learning for Distributed Multi-Robot Problems

Adaptive Environment Modeling Based Reinforcement Learning for Collision Avoidance in Complex Scenes

Safety Guaranteed Robust Multi-Agent Reinforcement Learning with Hierarchical Control for Connected and Automated Vehicles