Abstract:It is challenging to avoid obstacles safely and efficiently for multiple robots of different shapes in distributed and communication-free scenarios, where robots do not communicate with each other and only sense other robots’ positions and obstacles around them. Most existing multi-robot collision avoidance systems either require communication between robots or require expensive movement data of other robots, like velocities, accelerations and paths. In this paper, we propose a map-based deep reinforcement learning approach for multi-robot collision avoidance in a distributed and communication-free environment. We use the egocentric local grid map of a robot to represent the environmental information around it including its shape and observable appearances of other robots and obstacles, which can be easily generated by using multiple sensors or sensor fusion. Then we apply the distributed proximal policy optimization (DPPO) algorithm to train a convolutional neural network that directly maps three frames of egocentric local grid maps and the robot’s relative local goal positions into low-level robot control commands. Compared to other methods, the map-based approach is more robust to noisy sensor data, does not require robots’ movement data and considers sizes and shapes of related robots, which make it to be more efficient and easier to be deployed to real robots. We first train the neural network in a specified simulator of multiple mobile robots using DPPO, where a multi-stage curriculum learning strategy for multiple scenarios is used to improve the performance. Then we deploy the trained model to real robots to perform collision avoidance in their navigation without tedious parameter tuning. We evaluate the approach with multiple scenarios both in the simulator and on four differential-drive mobile robots in the real world. Both qualitative and quantitative experiments show that our approach is efficient and outperforms existing DRL-based approaches in many indicators. We also conduct ablation studies showing the positive effects of using egocentric grid maps and multi-stage curriculum learning.

Semantically-enhanced Deep Collision Prediction for Autonomous Navigation using Aerial Robots

Reinforcement Learning for Collision-free Flight Exploiting Deep Collision Encoding

Collaborative Recognition of Feasible Region with Aerial and Ground Robots Through DPCN

Deep-Learned Collision Avoidance Policy for Distributed Multi-Agent Navigation.

A robust collision prediction and detection method based on neural network for autonomous delivery robots

An Edge Architecture for Enabling Autonomous Aerial Navigation with Embedded Collision Avoidance Through Remote Nonlinear Model Predictive Control

Collision-Free Robot Navigation in Crowded Environments using Learning based Convex Model Predictive Control

Task-driven Compression for Collision Encoding based on Depth Images

Collision Anticipation via Deep Reinforcement Learning for Visual Navigation

Deep-Reinforcement-Learning-Based Collision Avoidance in UAV Environment

Fully Distributed Multi-Robot Collision Avoidance via Deep Reinforcement Learning for Safe and Efficient Navigation in Complex Scenarios

Enhancing Navigational Safety in Crowded Environments using Semantic-Deep-Reinforcement-Learning-based Navigation

Deep Reinforcement Learning for Robot Collision Avoidance With Self-State-Attention and Sensor Fusion

Accelerated Sim-to-Real Deep Reinforcement Learning: Learning Collision Avoidance from Human Player

BCSSN: Bi-direction Compact Spatial Separable Network for Collision Avoidance in Autonomous Driving

Nearest-Neighbor-based Collision Avoidance for Quadrotors via Reinforcement Learning

Intent Prediction-Driven Model Predictive Control for UAV Planning and Navigation in Dynamic Environments

Reactive Obstacle Avoidance of Monocular Quadrotors with Online Adapted Depth Prediction Network.

Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimation

Distributed Non-Communicating Multi-Robot Collision Avoidance Via Map-Based Deep Reinforcement Learning

Multimodal audio-visual robot fusing 3D CNN and CRNN for player behavior recognition and prediction in basketball matches