Abstract:With the rapid development of mobile robot technology, robots are playing an increasingly important role in people's daily lives. As one of the key technologies of the basic functions of mobile robots, navigation also needs to deal with new challenges. How to navigate efficiently and collision-free in complex and changeable human environments is one of the problems that need to be solved urgently. Currently, mobile robots can achieve efficient navigation in static environments. However, in the unstructured and fast-changing environments of human daily society, robots need to make more flexible navigation strategies to deal with the dynamic scenarios. This paper built a 3D simulation environment for robot navigation via deep reinforcement learning in dense pedestrian environment. We also proposed a new navigation approach via deep reinforcement learning in dense pedestrian environment. The simulation environment of this paper integrates Gazebo, ROS navigation stack, Stable baselines and Social Force Pedestrian Simulator. In order to be able to collect the rich environmental information around the robot, our simulation environment is based on the Gazebo simulation platform. In order to use the traditional path planning methods, we introduce the ROS navigation stack. In order to make it easier to call the current mainstream reinforcement learning algorithms, we introduce Stable baselines which is a set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines. In order to imitate dense pedestrian scenarios realistically, we introduce the Social Force Pedestrian Simulator which is a pedestrian simulation package, whose pedestrian's movement follows the rules of Social Force Movement. Our robot navigation approach combines the global optimality of traditional global path planning and the local barrier ability of reinforcement learning. Firstly, we plan global path by using A* algorithm. Secondly, we use Soft Actor Critic (SAC) to try to follow the waypoints generated at a certain distance on the global path to make action decisions on the premise of agile obstacle avoidance. Experiments show that our simulation environment can easily set up a robot navigation environment and navigation approaches can be simulated in various dense pedestrian environments.

Towards Safe and Efficient Last-Mile Delivery: A Multi-Modal Socially Aware Navigation Framework for Autonomous Robots on Pedestrian-Crowded Sidewalks

CrowdMove: Autonomous Mapless Navigation in Crowded Scenarios

Vision Based Sidewalk Navigation for Last-mile Delivery Robot

Robot Navigation Based on Human Trajectory Prediction and Multiple Travel Modes

Crowd-Aware Socially Compliant Robot Navigation via Deep Reinforcement Learning

Minimally-intrusive Navigation in Dense Crowds with Integrated Macro and Micro-level Dynamics

Safe and socially compliant robot navigation in crowds with fast-moving pedestrians via deep reinforcement learning

Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning

Following Social Groups: Socially Compliant Autonomous Navigation in Dense Crowds

Autonomous social robot navigation in unknown urban environments using semantic segmentation

Social navigation framework for assistive robots in human inhabited unknown environments

Group Surfing: A Pedestrian-Based Approach to Sidewalk Robot Navigation

Social Robot Navigation and Comfortable Following: A Novel Knowledge-Based Robot-Pedestrian Interaction Model with Self Learning Strategy.

Learning to Navigate Sidewalks in Outdoor Environments

Robot Crowd Navigation Based on Spatio-Temporal Interaction Graphs and Danger Zones

Learning World Transition Model for Socially Aware Robot Navigation

Socially Aware Crowd Navigation with Multimodal Pedestrian Trajectory Prediction for Autonomous Vehicles

A 3D Simulation Environment and Navigation Approach for Robot Navigation Via Deep Reinforcement Learning in Dense Pedestrian Environment.

Learning to Socially Navigate in Pedestrian-rich Environments with Interaction Capacity

Efficient Exploration in Crowds by Coupling Navigation Controller and Exploration Planner

Enhancing Socially-Aware Robot Navigation through Bidirectional Natural Language Conversation