Abstract:In this paper, we present a decentralized sensor-level collision avoidance policy for multi-robot systems, which shows promising results in practical applications. In particular, our policy directly maps raw sensor measurements to an agent's steering commands in terms of the movement velocity. As a first step toward reducing the performance gap between decentralized and centralized methods, we present a multi-scenario multi-stage training framework to learn an optimal policy. The policy is trained over a large number of robots in rich, complex environments simultaneously using a policy gradient based reinforcement learning algorithm. The learning algorithm is also integrated into a hybrid control framework to further improve the policy's robustness and effectiveness. We validate the learned sensor-level collision avoidance policy in a variety of simulated and real-world scenarios with thorough performance evaluations for large-scale multi-robot systems. The generalization of the learned policy is verified in a set of unseen scenarios including the navigation of a group of heterogeneous robots and a large-scale scenario with 100 robots. Although the policy is trained using simulation data only, we have successfully deployed it on physical robots with shapes and dynamics characteristics that are different from the simulated agents, in order to demonstrate the controller's robustness against the sim-to-real modeling error. Finally, we show that the collision-avoidance policy learned from multi-robot navigation tasks provides an excellent solution to the safe and effective autonomous navigation for a single robot working in a dense real human crowd. Our learned policy enables a robot to make effective progress in a crowd without getting stuck. Videos are available at <a class="link-external link-https" href="https://sites.google.com/view/hybridmrca" rel="external noopener nofollow">this https URL</a>

Global Map Assisted Multi-Agent Collision Avoidance Via Deep Reinforcement Learning Around Complex Obstacles

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Socially-Aware Multi-Agent Following with 2D Laser Scans Via Deep Reinforcement Learning and Potential Field

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Collision Avoidance Among Dense Heterogeneous Agents Using Deep Reinforcement Learning

Multi-agent navigation based on deep reinforcement learning and traditional pathfinding algorithm

Efficient Multi-agent Navigation with Lightweight DRL Policy

Neural Graph Control Barrier Functions Guided Distributed Collision-avoidance Multi-agent Control

Multi-Agent Reinforcement Learning-Based UAV Pathfinding for Obstacle Avoidance in Stochastic Environment

Adaptive Environment Modeling Based Reinforcement Learning for Collision Avoidance in Complex Scenes

Reciprocal Collision Avoidance for General Nonlinear Agents using Reinforcement Learning

Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning

MAP3F: a decentralized approach to multi-agent pathfinding and collision avoidance with scalable 1D, 2D, and 3D feature fusion

The Design and Realization of Multi-agent Obstacle Avoidance based on Reinforcement Learning

Fully Distributed Multi-Robot Collision Avoidance via Deep Reinforcement Learning for Safe and Efficient Navigation in Complex Scenarios

Obstacle Avoidance in Multi-Agent Formation Process Based on Deep Reinforcement Learning

A Reinforcement Learning-based Decentralized Method of Avoiding Multi-UAV Collision in 3-D Airspace

Multiagent Path Finding Using Deep Reinforcement Learning Coupled With Hot Supervision Contrastive Loss

Sensor-based Multi-agent Coverage Control with Spatial Separation in Unstructured Environments