Abstract:It is challenging to avoid obstacles safely and efficiently for multiple robots of different shapes in distributed and communication-free scenarios, where robots do not communicate with each other and only sense other robots’ positions and obstacles around them. Most existing multi-robot collision avoidance systems either require communication between robots or require expensive movement data of other robots, like velocities, accelerations and paths. In this paper, we propose a map-based deep reinforcement learning approach for multi-robot collision avoidance in a distributed and communication-free environment. We use the egocentric local grid map of a robot to represent the environmental information around it including its shape and observable appearances of other robots and obstacles, which can be easily generated by using multiple sensors or sensor fusion. Then we apply the distributed proximal policy optimization (DPPO) algorithm to train a convolutional neural network that directly maps three frames of egocentric local grid maps and the robot’s relative local goal positions into low-level robot control commands. Compared to other methods, the map-based approach is more robust to noisy sensor data, does not require robots’ movement data and considers sizes and shapes of related robots, which make it to be more efficient and easier to be deployed to real robots. We first train the neural network in a specified simulator of multiple mobile robots using DPPO, where a multi-stage curriculum learning strategy for multiple scenarios is used to improve the performance. Then we deploy the trained model to real robots to perform collision avoidance in their navigation without tedious parameter tuning. We evaluate the approach with multiple scenarios both in the simulator and on four differential-drive mobile robots in the real world. Both qualitative and quantitative experiments show that our approach is efficient and outperforms existing DRL-based approaches in many indicators. We also conduct ablation studies showing the positive effects of using egocentric grid maps and multi-stage curriculum learning.

Configuration Space Decomposition for Learning-based Collision Checking in High-DOF Robots

Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

Direct Robot Configuration Space Construction using Convolutional Encoder-Decoders

Collision-free motion planning of dual-arm reconfigurable robots

Active learning of the collision distance function for high-DOF multi-arm robot systems

Finding and Optimizing Certified, Collision-Free Regions in Configuration Space for Robot Manipulators

DeepCollide: Scalable Data-Driven High DoF Configuration Space Modeling using Implicit Neural Representations

Collision-Free Trajectory Planning for a 6-DoF Free-Floating Space Robot via Hierarchical Decoupling Optimization

Visualizing High-Dimensional Configuration Spaces: A Comprehensive Analytical Approach

A Learning System for Motion Planning of Free-Float Dual-Arm Space Manipulator towards Non-Cooperative Object

Self-collision Avoidance Trajectory Planning and Robust Control of a Dual-arm Space Robot

Collision-Free Robot Navigation in Crowded Environments using Learning based Convex Model Predictive Control

Fast Motion Planning for High-DOF Robot Systems Using Hierarchical System Identification

Solving the Real-Time Motion Planning Problem for Non-Holonomic Robots with Collision Avoidance in Dynamic Scenes

Distributed Non-Communicating Multi-Robot Collision Avoidance Via Map-Based Deep Reinforcement Learning

Motion Planning and Cooperative Manipulation for Mobile Robots with Dual Arms

Learning-Based Proxy Collision Detection for Robot Motion Planning Applications

Deep learning-based optimization for motion planning of dual-arm assembly robots

Real-time collision-free path planning for robots in configuration space

Efficient Collision Detection Framework for Enhancing Collision-Free Robot Motion

Configuration Space Distance Fields for Manipulation Planning