Abstract:With the rapid development of mobile robot technology, robots are playing an increasingly important role in people's daily lives. As one of the key technologies of the basic functions of mobile robots, navigation also needs to deal with new challenges. How to navigate efficiently and collision-free in complex and changeable human environments is one of the problems that need to be solved urgently. Currently, mobile robots can achieve efficient navigation in static environments. However, in the unstructured and fast-changing environments of human daily society, robots need to make more flexible navigation strategies to deal with the dynamic scenarios. This paper built a 3D simulation environment for robot navigation via deep reinforcement learning in dense pedestrian environment. We also proposed a new navigation approach via deep reinforcement learning in dense pedestrian environment. The simulation environment of this paper integrates Gazebo, ROS navigation stack, Stable baselines and Social Force Pedestrian Simulator. In order to be able to collect the rich environmental information around the robot, our simulation environment is based on the Gazebo simulation platform. In order to use the traditional path planning methods, we introduce the ROS navigation stack. In order to make it easier to call the current mainstream reinforcement learning algorithms, we introduce Stable baselines which is a set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines. In order to imitate dense pedestrian scenarios realistically, we introduce the Social Force Pedestrian Simulator which is a pedestrian simulation package, whose pedestrian's movement follows the rules of Social Force Movement. Our robot navigation approach combines the global optimality of traditional global path planning and the local barrier ability of reinforcement learning. Firstly, we plan global path by using A* algorithm. Secondly, we use Soft Actor Critic (SAC) to try to follow the waypoints generated at a certain distance on the global path to make action decisions on the premise of agile obstacle avoidance. Experiments show that our simulation environment can easily set up a robot navigation environment and navigation approaches can be simulated in various dense pedestrian environments.

A Mobile Robot Experiment System with Lightweight Simulator Generator for Deep Reinforcement Learning Algorithm.

FastSim: A Modular and Plug-and-Play Simulator for Aerial Robots

Robot Simulation and Reinforcement Learning Training Platform Based on Distributed Architecture.

HumRoboSim: an Autonomous Humanoid Robot Simulation System

Real-Time SLAM and Faster Object Detection on a Wheeled Lifting Robot with Mobile-ROS Interaction

RobotDrlSim: A Real Time Robot Simulation Platform for Reinforcement Learning and Human Interactive Demonstration Learning

RoboGSim: A Real2Sim2Real Robotic Gaussian Splatting Simulator

Development of A Low-Cost High-Fidelity Simulator for Search and Rescue Robot

Multi-robot Cooperative Transport Simulation System

Crowd-Steer: Realtime Smooth and Collision-Free Robot Navigation in Densely Crowded Scenarios Trained using High-Fidelity Simulation

Accelerated Sim-to-Real Deep Reinforcement Learning: Learning Collision Avoidance from Human Player

Design and Implement an Enhanced Simulator for Autonomous Delivery Robot

DeepRacer: Educational Autonomous Racing Platform for Experimentation with Sim2Real Reinforcement Learning

Bypassing the Simulation-to-reality Gap: Online Reinforcement Learning using a Supervisor

A Gamified Simulator and Physical Platform for Self-Driving Algorithm Training and Validation

A Virtual Experiment Platform for 2D Robot Autonomous Navigation Algorithm System Based on ROS

A 3D Simulation Environment and Navigation Approach for Robot Navigation Via Deep Reinforcement Learning in Dense Pedestrian Environment.

A novel simulation reality closed loop learning framework for autonomous robot skill learning

Low-Cost Multi-Agent Navigation Via Reinforcement Learning with Multi-Fidelity Simulator.

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

End-to-End and Highly-Efficient Differentiable Simulation for Robotics