Abstract:With the rapid development of mobile robot technology, robots are playing an increasingly important role in people's daily lives. As one of the key technologies of the basic functions of mobile robots, navigation also needs to deal with new challenges. How to navigate efficiently and collision-free in complex and changeable human environments is one of the problems that need to be solved urgently. Currently, mobile robots can achieve efficient navigation in static environments. However, in the unstructured and fast-changing environments of human daily society, robots need to make more flexible navigation strategies to deal with the dynamic scenarios. This paper built a 3D simulation environment for robot navigation via deep reinforcement learning in dense pedestrian environment. We also proposed a new navigation approach via deep reinforcement learning in dense pedestrian environment. The simulation environment of this paper integrates Gazebo, ROS navigation stack, Stable baselines and Social Force Pedestrian Simulator. In order to be able to collect the rich environmental information around the robot, our simulation environment is based on the Gazebo simulation platform. In order to use the traditional path planning methods, we introduce the ROS navigation stack. In order to make it easier to call the current mainstream reinforcement learning algorithms, we introduce Stable baselines which is a set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines. In order to imitate dense pedestrian scenarios realistically, we introduce the Social Force Pedestrian Simulator which is a pedestrian simulation package, whose pedestrian's movement follows the rules of Social Force Movement. Our robot navigation approach combines the global optimality of traditional global path planning and the local barrier ability of reinforcement learning. Firstly, we plan global path by using A* algorithm. Secondly, we use Soft Actor Critic (SAC) to try to follow the waypoints generated at a certain distance on the global path to make action decisions on the premise of agile obstacle avoidance. Experiments show that our simulation environment can easily set up a robot navigation environment and navigation approaches can be simulated in various dense pedestrian environments.

Multi-agent navigation based on deep reinforcement learning and traditional pathfinding algorithm

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Hierarchical Reinforcement Learning Framework towards Multi-agent Navigation

Multi-Agent Reinforcement Learning-Based UAV Pathfinding for Obstacle Avoidance in Stochastic Environment

Efficient Multi-agent Cooperative Navigation in Unknown Environments with Interlaced Deep Reinforcement Learning.

Multi-Agent Path Planning Method Based on Improved Deep Q-Network in Dynamic Environments

Global Map Assisted Multi-Agent Collision Avoidance Via Deep Reinforcement Learning Around Complex Obstacles

Distributed Non-Communicating Multi-Robot Collision Avoidance Via Map-Based Deep Reinforcement Learning

MAP3F: a decentralized approach to multi-agent pathfinding and collision avoidance with scalable 1D, 2D, and 3D feature fusion

The Design and Realization of Multi-agent Obstacle Avoidance based on Reinforcement Learning

Danger-aware Adaptive Composition of DRL Agents for Self-navigation

Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation

Multi-Agent Path Planning Using Deep Reinforcement Learning

Efficient Multi-agent Navigation with Lightweight DRL Policy

Learning team-based navigation: a review of deep reinforcement learning techniques for multi-agent pathfinding

Collision Avoidance Among Dense Heterogeneous Agents Using Deep Reinforcement Learning

A 3D Simulation Environment and Navigation Approach for Robot Navigation Via Deep Reinforcement Learning in Dense Pedestrian Environment.

Multi-agent Pathfinding with Local and Global Guidance

Obstacle Avoidance in Multi-Agent Formation Process Based on Deep Reinforcement Learning