Abstract:Developing a safe and efficient collision-avoidance policy for multiple robots is challenging in the decentralized scenarios where each robot generates its paths with limited observation of other robots’ states and intentions. Prior distributed multi-robot collision-avoidance systems often require frequent inter-robot communication or agent-level features to plan a local collision-free action, which is not robust and computationally prohibitive. In addition, the performance of these methods is not comparable with their centralized counterparts in practice. In this article, we present a decentralized sensor-level collision-avoidance policy for multi-robot systems, which shows promising results in practical applications. In particular, our policy directly maps raw sensor measurements to an agent’s steering commands in terms of the movement velocity. As a first step toward reducing the performance gap between decentralized and centralized methods, we present a multi-scenario multi-stage training framework to learn an optimal policy. The policy is trained over a large number of robots in rich, complex environments simultaneously using a policy-gradient-based reinforcement-learning algorithm. The learning algorithm is also integrated into a hybrid control framework to further improve the policy’s robustness and effectiveness. We validate the learned sensor-level collision-3avoidance policy in a variety of simulated and real-world scenarios with thorough performance evaluations for large-scale multi-robot systems. The generalization of the learned policy is verified in a set of unseen scenarios including the navigation of a group of heterogeneous robots and a large-scale scenario with 100 robots. Although the policy is trained using simulation data only, we have successfully deployed it on physical robots with shapes and dynamics characteristics that are different from the simulated agents, in order to demonstrate the controller’s robustness against the simulation-to-real modeling error. Finally, we show that the collision-avoidance policy learned from multi-robot navigation tasks provides an excellent solution for safe and effective autonomous navigation for a single robot working in a dense real human crowd. Our learned policy enables a robot to make effective progress in a crowd without getting stuck. More importantly, the policy has been successfully deployed on different types of physical robot platforms without tedious parameter tuning. Videos are available at https://sites.google.com/view/hybridmrca.

Decentralized and Communication-Free Multi-Robot Navigation through Distributed Games

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Deadlock-free, Safe, and Decentralized Multi-Robot Navigation in Social Mini-Games via Discrete-Time Control Barrier Functions

Decentralized Social Navigation with Non-Cooperative Robots via Bi-Level Optimization

Distributed Navigation of Multi-Robot Systems For Sensing Coverage

Communication- and Computation-Efficient Distributed Decision-Making in Multi-Robot Networks

Navigation Function Based Decentralized Control of A Multi-Agent System with Network Connectivity Constraints

Decentralized Strategy for Cooperative Multi-Robot Exploration and Mapping

A fully distributed multi-robot navigation method without pre-allocating target positions

Decentralized, Unlabeled Multi-Agent Navigation in Obstacle-Rich Environments Using Graph Neural Networks

Continuous-Time Trajectory Optimization for Decentralized Multi-Robot Navigation

Collision-Free Multi Robot Trajectory Optimization in Unknown Environments using Decentralized Trajectory Planning

DMCA: Dense Multi-agent Navigation using Attention and Communication

Decentralized Role Assignment in Multi-Agent Teams via Empirical Game-Theoretic Analysis

Decentralized Rendezvous of Nonholonomic Robots with Sensing and Connectivity Constraints

Decentralized Motion Planning for Multi-Robot Navigation using Deep Reinforcement Learning

Ensuring Progress for Multiple Mobile Robots via Space Partitioning, Motion Rules, and Adaptively Centralized Conflict Resolution

Distributed Non-Communicating Multi-Robot Collision Avoidance Via Map-Based Deep Reinforcement Learning

Decentralized Global Connectivity Maintenance for Multi-Robot Navigation: A Reinforcement Learning Approach

Distributed Multi-Robot Collision Avoidance Via Deep Reinforcement Learning for Navigation in Complex Scenarios