Abstract:With the rapid development of mobile robot technology, robots are playing an increasingly important role in people's daily lives. As one of the key technologies of the basic functions of mobile robots, navigation also needs to deal with new challenges. How to navigate efficiently and collision-free in complex and changeable human environments is one of the problems that need to be solved urgently. Currently, mobile robots can achieve efficient navigation in static environments. However, in the unstructured and fast-changing environments of human daily society, robots need to make more flexible navigation strategies to deal with the dynamic scenarios. This paper built a 3D simulation environment for robot navigation via deep reinforcement learning in dense pedestrian environment. We also proposed a new navigation approach via deep reinforcement learning in dense pedestrian environment. The simulation environment of this paper integrates Gazebo, ROS navigation stack, Stable baselines and Social Force Pedestrian Simulator. In order to be able to collect the rich environmental information around the robot, our simulation environment is based on the Gazebo simulation platform. In order to use the traditional path planning methods, we introduce the ROS navigation stack. In order to make it easier to call the current mainstream reinforcement learning algorithms, we introduce Stable baselines which is a set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines. In order to imitate dense pedestrian scenarios realistically, we introduce the Social Force Pedestrian Simulator which is a pedestrian simulation package, whose pedestrian's movement follows the rules of Social Force Movement. Our robot navigation approach combines the global optimality of traditional global path planning and the local barrier ability of reinforcement learning. Firstly, we plan global path by using A* algorithm. Secondly, we use Soft Actor Critic (SAC) to try to follow the waypoints generated at a certain distance on the global path to make action decisions on the premise of agile obstacle avoidance. Experiments show that our simulation environment can easily set up a robot navigation environment and navigation approaches can be simulated in various dense pedestrian environments.

B-GAP: Behavior-Rich Simulation and Navigation for Autonomous Driving

Microscopic Traffic Simulation by Cooperative Multi-agent Deep Reinforcement Learning

Building Safer Autonomous Agents by Leveraging Risky Driving Behavior Knowledge

Autonomous Highway Driving using Deep Reinforcement Learning

DQ-GAT: Towards Safe and Efficient Autonomous Driving With Deep Q-Learning and Graph Attention Networks

SocNavGym: A Reinforcement Learning Gym for Social Navigation

Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarios

Deep reinforcement learning for autonomous driving in uncontrolled intersections of Indian roads

Learning Robust Control Policies for End-to-End Autonomous Driving From Data-Driven Simulation

AutoVRL: A High Fidelity Autonomous Ground Vehicle Simulator for Sim-to-Real Deep Reinforcement Learning

Crowd-Steer: Realtime Smooth and Collision-Free Robot Navigation in Densely Crowded Scenarios Trained using High-Fidelity Simulation

Autonomous navigation at unsignalized intersections: A coupled reinforcement learning and model predictive control approach

Navigational Behavior of Humans and Deep Reinforcement Learning Agents

Subgoal-Driven Navigation in Dynamic Environments Using Attention-Based Deep Reinforcement Learning

A 3D Simulation Environment and Navigation Approach for Robot Navigation Via Deep Reinforcement Learning in Dense Pedestrian Environment.

Scalable Traffic Simulation for Autonomous Driving Via Multi-Agent Goal Assignment and Autoregressive Goal-Directed Planning

Closing the gap towards end-to-end autonomous vehicle system

ReinforcementDriving: Exploring Trajectories and Navigation for Autonomous Vehicles

Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA

Versatile Behavior Diffusion for Generalized Traffic Agent Simulation