Abstract:With the rapid development of mobile robot technology, robots are playing an increasingly important role in people's daily lives. As one of the key technologies of the basic functions of mobile robots, navigation also needs to deal with new challenges. How to navigate efficiently and collision-free in complex and changeable human environments is one of the problems that need to be solved urgently. Currently, mobile robots can achieve efficient navigation in static environments. However, in the unstructured and fast-changing environments of human daily society, robots need to make more flexible navigation strategies to deal with the dynamic scenarios. This paper built a 3D simulation environment for robot navigation via deep reinforcement learning in dense pedestrian environment. We also proposed a new navigation approach via deep reinforcement learning in dense pedestrian environment. The simulation environment of this paper integrates Gazebo, ROS navigation stack, Stable baselines and Social Force Pedestrian Simulator. In order to be able to collect the rich environmental information around the robot, our simulation environment is based on the Gazebo simulation platform. In order to use the traditional path planning methods, we introduce the ROS navigation stack. In order to make it easier to call the current mainstream reinforcement learning algorithms, we introduce Stable baselines which is a set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines. In order to imitate dense pedestrian scenarios realistically, we introduce the Social Force Pedestrian Simulator which is a pedestrian simulation package, whose pedestrian's movement follows the rules of Social Force Movement. Our robot navigation approach combines the global optimality of traditional global path planning and the local barrier ability of reinforcement learning. Firstly, we plan global path by using A* algorithm. Secondly, we use Soft Actor Critic (SAC) to try to follow the waypoints generated at a certain distance on the global path to make action decisions on the premise of agile obstacle avoidance. Experiments show that our simulation environment can easily set up a robot navigation environment and navigation approaches can be simulated in various dense pedestrian environments.

Learning Cross Dimension Scene Representation for Interactive Navigation Agents in Obstacle-Cluttered Environments

Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks

Multi-Object Navigation with dynamically learned neural implicit representations

Reinforcement Learning-Based Visual Navigation With Information-Theoretic Regularization

Improving Target-driven Visual Navigation with Attention on 3D Spatial Relationships

Multigoal Visual Navigation With Collision Avoidance via Deep Reinforcement Learning

Robot Navigation with Interaction-based Deep Reinforcement Learning

Interactive Navigation in Environments with Traversable Obstacles Using Large Language and Vision-Language Models

Collision Anticipation via Deep Reinforcement Learning for Visual Navigation

Learning to Navigate in Complex Environments

Learning 3D Navigation Protocols on Touch Interfaces with Cooperative Multi-agent Reinforcement Learning

From Two-Dimensional to Three-Dimensional Environment with Q-Learning: Modeling Autonomous Navigation with Reinforcement Learning and no Libraries

Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigation

Learning Efficient Multi-Agent Cooperative Visual Exploration

Volumetric Environment Representation for Vision-Language Navigation

Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models, Benchmark and Efficient Evaluation

A 3D Simulation Environment and Navigation Approach for Robot Navigation Via Deep Reinforcement Learning in Dense Pedestrian Environment.

3D-Aware Object Goal Navigation Via Simultaneous Exploration and Identification

Action-Insensitive Embodied Visual Navigation

HRL4IN: Hierarchical Reinforcement Learning for Interactive Navigation with Mobile Manipulators

Learning Navigational Visual Representations with Semantic Map Supervision