Abstract:It is challenging to avoid obstacles safely and efficiently for multiple robots of different shapes in distributed and communication-free scenarios, where robots do not communicate with each other and only sense other robots’ positions and obstacles around them. Most existing multi-robot collision avoidance systems either require communication between robots or require expensive movement data of other robots, like velocities, accelerations and paths. In this paper, we propose a map-based deep reinforcement learning approach for multi-robot collision avoidance in a distributed and communication-free environment. We use the egocentric local grid map of a robot to represent the environmental information around it including its shape and observable appearances of other robots and obstacles, which can be easily generated by using multiple sensors or sensor fusion. Then we apply the distributed proximal policy optimization (DPPO) algorithm to train a convolutional neural network that directly maps three frames of egocentric local grid maps and the robot’s relative local goal positions into low-level robot control commands. Compared to other methods, the map-based approach is more robust to noisy sensor data, does not require robots’ movement data and considers sizes and shapes of related robots, which make it to be more efficient and easier to be deployed to real robots. We first train the neural network in a specified simulator of multiple mobile robots using DPPO, where a multi-stage curriculum learning strategy for multiple scenarios is used to improve the performance. Then we deploy the trained model to real robots to perform collision avoidance in their navigation without tedious parameter tuning. We evaluate the approach with multiple scenarios both in the simulator and on four differential-drive mobile robots in the real world. Both qualitative and quantitative experiments show that our approach is efficient and outperforms existing DRL-based approaches in many indicators. We also conduct ablation studies showing the positive effects of using egocentric grid maps and multi-stage curriculum learning.

Robust Motion Planning for Multi-Robot Systems Against Position Deception Attacks

RL and ANN Based Modular Path Planning Controller for Resource-Constrained Robots in the Indoor Complex Dynamic Environment

Robust motion planning for mobile robots under attacks against obstacle localization

Path Planning and Information Protection of Mobile Robots Based on Deceptive Reinforcement Learning

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

Attention-based advantage actor-critic algorithm with prioritized experience replay for complex 2-D robotic motion planning

Robust Adversarial Attacks Detection based on Explainable Deep Reinforcement Learning For UAV Guidance and Planning

Representation Learning and Reinforcement Learning for Dynamic Complex Motion Planning System

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Path Planning in Dynamic Environments through Trajectory Prediction and Reinforcement Learning

Deep Reinforcement Learning for Multi-contact Motion Planning of Hexapod Robots

Deep Reinforcement Learning with Multi-Critic TD3 for Decentralized Multi-Robot Path Planning

Distributed Non-Communicating Multi-Robot Collision Avoidance Via Map-Based Deep Reinforcement Learning

Multi-Agent Guided Deep Reinforcement Learning Approach Against State Perturbed Adversarial Attacks

GAN-Based Robust Motion Planning for Mobile Robots Against Localization Attacks

A Reinforcement Learning Based Motion Planner for Quadrotor Autonomous Flight in Dense Environment

Multi-Robot Motion Planning: A Learning-Based Artificial Potential Field Solution

An Obstacle-Avoidance Motion Planning Method for Redundant Space Robot via Reinforcement Learning

Safe Reinforcement Learning-Based Motion Planning for Functional Mobile Robots Suffering Uncontrollable Mobile Robots

Dynamic Obstacle Avoidance Algorithm for Robot Arm Based on Deep Reinforcement Learning

Multimodal Deep Reinforcement Learning with Auxiliary Task for Obstacle Avoidance of Indoor Mobile Robot