Abstract:With the rapid development of mobile robot technology, robots are playing an increasingly important role in people's daily lives. As one of the key technologies of the basic functions of mobile robots, navigation also needs to deal with new challenges. How to navigate efficiently and collision-free in complex and changeable human environments is one of the problems that need to be solved urgently. Currently, mobile robots can achieve efficient navigation in static environments. However, in the unstructured and fast-changing environments of human daily society, robots need to make more flexible navigation strategies to deal with the dynamic scenarios. This paper built a 3D simulation environment for robot navigation via deep reinforcement learning in dense pedestrian environment. We also proposed a new navigation approach via deep reinforcement learning in dense pedestrian environment. The simulation environment of this paper integrates Gazebo, ROS navigation stack, Stable baselines and Social Force Pedestrian Simulator. In order to be able to collect the rich environmental information around the robot, our simulation environment is based on the Gazebo simulation platform. In order to use the traditional path planning methods, we introduce the ROS navigation stack. In order to make it easier to call the current mainstream reinforcement learning algorithms, we introduce Stable baselines which is a set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines. In order to imitate dense pedestrian scenarios realistically, we introduce the Social Force Pedestrian Simulator which is a pedestrian simulation package, whose pedestrian's movement follows the rules of Social Force Movement. Our robot navigation approach combines the global optimality of traditional global path planning and the local barrier ability of reinforcement learning. Firstly, we plan global path by using A* algorithm. Secondly, we use Soft Actor Critic (SAC) to try to follow the waypoints generated at a certain distance on the global path to make action decisions on the premise of agile obstacle avoidance. Experiments show that our simulation environment can easily set up a robot navigation environment and navigation approaches can be simulated in various dense pedestrian environments.

RL-DOVS: Reinforcement Learning for Autonomous Robot Navigation in Dynamic Environments

Deep reinforcement learning oriented for real world dynamic scenarios

RUMOR: Reinforcement learning for Understanding a Model of the Real World for Navigation in Dynamic Environments

Deep Reinforcement Learning based Robot Navigation in Dynamic Environments using Occupancy Values of Motion Primitives.

iNAV-drlSLAM: An Improved Indoor Self-Driving Framework for Mobile Robots using Deep Reinforcement Learning integrated with SLAM

Vision-based navigation and obstacle avoidance via deep reinforcement learning

Self-Learning Robot Autonomous Navigation with Deep Reinforcement Learning Techniques

Goal-Driven Autonomous Exploration Through Deep Reinforcement Learning

Intelligent mobile robot navigation in unknown and complex environment using reinforcement learning technique

Deep Reinforcement Learning for Localizability-Enhanced Navigation in Dynamic Human Environments

Dynamic warning zone and a short-distance goal for autonomous robot navigation using deep reinforcement learning

Robot navigation in crowds via deep reinforcement learning with modeling of obstacle uni-action

Sim-to-Real Strategy for Spatially Aware Robot Navigation in Uneven Outdoor Environments

Reinforcement Learned Distributed Multi-Robot Navigation With Reciprocal Velocity Obstacle Shaped Rewards

NavDreams: Towards Camera-Only RL Navigation Among Humans

A 3D Simulation Environment and Navigation Approach for Robot Navigation Via Deep Reinforcement Learning in Dense Pedestrian Environment.

Exploring the Potential of Deep Reinforcement Learning for Autonomous Navigation in Complex Environments

Addressing unpredictable movements of dynamic obstacles with deep reinforcement learning to ensure safe navigation for omni-wheeled mobile robot

Dynamic Obstacle Avoidance Technique for Mobile Robot Navigation Using Deep Reinforcement Learning

Robot path planning using deep reinforcement learning

Autonomous Navigation of UAV in Multi-Obstacle Environments Based on a Deep Reinforcement Learning Approach