Abstract:With the rapid development of mobile robot technology, robots are playing an increasingly important role in people's daily lives. As one of the key technologies of the basic functions of mobile robots, navigation also needs to deal with new challenges. How to navigate efficiently and collision-free in complex and changeable human environments is one of the problems that need to be solved urgently. Currently, mobile robots can achieve efficient navigation in static environments. However, in the unstructured and fast-changing environments of human daily society, robots need to make more flexible navigation strategies to deal with the dynamic scenarios. This paper built a 3D simulation environment for robot navigation via deep reinforcement learning in dense pedestrian environment. We also proposed a new navigation approach via deep reinforcement learning in dense pedestrian environment. The simulation environment of this paper integrates Gazebo, ROS navigation stack, Stable baselines and Social Force Pedestrian Simulator. In order to be able to collect the rich environmental information around the robot, our simulation environment is based on the Gazebo simulation platform. In order to use the traditional path planning methods, we introduce the ROS navigation stack. In order to make it easier to call the current mainstream reinforcement learning algorithms, we introduce Stable baselines which is a set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines. In order to imitate dense pedestrian scenarios realistically, we introduce the Social Force Pedestrian Simulator which is a pedestrian simulation package, whose pedestrian's movement follows the rules of Social Force Movement. Our robot navigation approach combines the global optimality of traditional global path planning and the local barrier ability of reinforcement learning. Firstly, we plan global path by using A* algorithm. Secondly, we use Soft Actor Critic (SAC) to try to follow the waypoints generated at a certain distance on the global path to make action decisions on the premise of agile obstacle avoidance. Experiments show that our simulation environment can easily set up a robot navigation environment and navigation approaches can be simulated in various dense pedestrian environments.

Mini bot 3D: A ROS based Gazebo Simulation

A Comprehensive Simulation Testbench For Aerial Robot In Dynamic Scenario Using Gazebo-Ros

Construction and Evaluation of SLAM and Navigation System for Mobile Robot Based on Diverse Environments.

Research and Implementation of Autonomous Navigation for Mobile Robots Based on SLAM Algorithm under ROS

Three-Dimensional Location and Mapping Analysis in Mobile Robotics Based on Visual SLAM Methods

Mobile Robot Navigation in Indoor Environments: Comparison of Lidar-Based 2D SLAM Algorithms

SLAM, Path Planning Algorithm and Application Research of an Indoor Substation Wheeled Robot Navigation System

Review of SLAM Algorithms for Indoor Mobile Robot with LIDAR and RGB-D Camera Technology

A 3D Simulation Environment and Navigation Approach for Robot Navigation Via Deep Reinforcement Learning in Dense Pedestrian Environment.

Development of an indoor localization and navigation system based on monocular SLAM for mobile robots

Localization and Navigation for Indoor Mobile Robot Based on ROS

Automatically Annotated Dataset of a Ground Mobile Robot in Natural Environments via Gazebo Simulations

End-to-End UAV Simulation for Visual SLAM and Navigation

Autonomous Navigation System of Greenhouse Mobile Robot Based on 3D Lidar and 2D Lidar SLAM

Autonomous Navigation System of Indoor Mobile Robots Using 2D Lidar

SLAM Algorithm Analysis of Mobile Robot Based on Lidar

Autonomous Systems: Autonomous Systems: Indoor Drone Navigation

Lidar-Based 2D SLAM for Mobile Robot in an Indoor Environment: A Review

Modelling and Simulation of a Non-Holonomic Omnidirectional Mobile Robot for Offline Programming and System Performance Analysis.

A LiDAR Mapping System for Robot Navigation in Dynamic Environments

3D lidar SLAM-based systems in object detection and navigation applications