Abstract:With the rapid development of mobile robot technology, robots are playing an increasingly important role in people's daily lives. As one of the key technologies of the basic functions of mobile robots, navigation also needs to deal with new challenges. How to navigate efficiently and collision-free in complex and changeable human environments is one of the problems that need to be solved urgently. Currently, mobile robots can achieve efficient navigation in static environments. However, in the unstructured and fast-changing environments of human daily society, robots need to make more flexible navigation strategies to deal with the dynamic scenarios. This paper built a 3D simulation environment for robot navigation via deep reinforcement learning in dense pedestrian environment. We also proposed a new navigation approach via deep reinforcement learning in dense pedestrian environment. The simulation environment of this paper integrates Gazebo, ROS navigation stack, Stable baselines and Social Force Pedestrian Simulator. In order to be able to collect the rich environmental information around the robot, our simulation environment is based on the Gazebo simulation platform. In order to use the traditional path planning methods, we introduce the ROS navigation stack. In order to make it easier to call the current mainstream reinforcement learning algorithms, we introduce Stable baselines which is a set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines. In order to imitate dense pedestrian scenarios realistically, we introduce the Social Force Pedestrian Simulator which is a pedestrian simulation package, whose pedestrian's movement follows the rules of Social Force Movement. Our robot navigation approach combines the global optimality of traditional global path planning and the local barrier ability of reinforcement learning. Firstly, we plan global path by using A* algorithm. Secondly, we use Soft Actor Critic (SAC) to try to follow the waypoints generated at a certain distance on the global path to make action decisions on the premise of agile obstacle avoidance. Experiments show that our simulation environment can easily set up a robot navigation environment and navigation approaches can be simulated in various dense pedestrian environments.

Learning visual path–following skills for industrial robot using deep reinforcement learning

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Hybrid learning-based visual path following for an industrial robot

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

Path Following for Autonomous Mobile Robots with Deep Reinforcement Learning

A Path-Integral-Based Reinforcement Learning Algorithm for Path Following of an Autoassembly Mobile Robot

Vision-Based Deep Reinforcement Learning For UR5 Robot Motion Control

Real-World Robot Reaching Skill Learning Based On Deep Reinforcement Learning

Learning Visual Tracking and Reaching with Deep Reinforcement Learning on a UR10e Robotic Arm

A Deep Reinforcement Learning Based Approach for AGVs Path Planning

A data-efficient goal-directed deep reinforcement learning method for robot visuomotor skill

Robot obstacle avoidance system using deep reinforcement learning

Deep Interactive Reinforcement Learning for Path Following of Autonomous Underwater Vehicle

A 3D Simulation Environment and Navigation Approach for Robot Navigation Via Deep Reinforcement Learning in Dense Pedestrian Environment.

Path Following Control for Unmanned Surface Vehicles: A Reinforcement Learning-Based Method with Experimental Validation.

Research on Robot Path Planning Based on Reinforcement Learning

Research on path planning of robot based on deep reinforcement learning

A Method to Plan the Path of a Robot Utilizing Deep Reinforcement Learning and Multi-Sensory Information Fusion

Robot Control in Human Environment Using Deep Reinforcement Learning and Convolutional Neural Network.

Visual Local Path Planning Based on Deep Reinforcement Learning

Deep-Reinforcement-Learning-based Path Planning for Industrial Robots using Distance Sensors as Observation