Abstract:In this paper, a two‐layer crowd evacuation simulation method based on deep reinforcement learning is proposed. The overall framework of the method is divided into two layers: in the global path planning layer, a deep deterministic policy gradient algorithm based on learning curves is proposed, which utilizes the learning curve theory to dynamically change the algorithm's experience pool capacity, and utilizes a prioritized experience sampling strategy to give higher sampling probabilities to experiences with learning value, thus improving the algorithm's learning efficiency; in the layer of the crowd's microscopic behaviors, an improved social force model is applied to the crowd's In the micro‐behavioral layer of the crowd, the improved social force model is used to model the micro‐motion of the crowd, which guides the crowd to avoid obstacles and reach the safe exit quickly. The experimental results show that the deep reinforcement learning‐based two‐layer crowd evacuation simulation method proposed in this paper can improve the path planning efficiency. Existing crowd evacuation simulation methods commonly face challenges of low efficiency in path planning and insufficient realism in pedestrian movement during the evacuation process. In this study, we propose a novel crowd evacuation path planning approach based on the learning curve–deep deterministic policy gradient (LC‐DDPG) algorithm. The algorithm incorporates dynamic experience pool and a priority experience sampling strategy, enhancing convergence speed and achieving higher average rewards, thus efficiently enabling global path planning. Building upon this foundation, we introduce a double‐layer method for crowd evacuation using deep reinforcement learning. Specifically, within each group, individuals are categorized into leaders and followers. At the top layer, we employ the LC‐DDPG algorithm to perform global path planning for the leaders. Simultaneously, at the bottom layer, an enhanced social force model guides the followers to avoid obstacles and follow the leaders during evacuation. We implemented a crowd evacuation simulation platform. Experimental results show that our proposed method has high path planning efficiency and can generate more realistic pedestrian trajectories in different scenarios and crowd sizes.

A deep reinforcement learning traffic control model for Pedestrian and vehicle evacuation in the parking lot

Pedestrians’ behavior in emergency evacuation: Modeling and simulation*

DYNAMIC EVACUATION AND VEHICLE ALLOCATION STRATEGY IN URBAN SAFETY PLANNING

A path planning method based on deep reinforcement learning for crowd evacuation

Deep reinforcement learning and 3D physical environments applied to crowd evacuation in congested scenarios

A double‐layer crowd evacuation simulation method based on deep reinforcement learning

Pedestrian Evacuation Modelling with Dynamics Congestion Avoidance

Refined Path Planning for Emergency Rescue Vehicles on Congested Urban Arterial Roads via Reinforcement Learning Approach

Modeling Adaptive Platoon and Reservation Based Autonomous Intersection Control: A Deep Reinforcement Learning Approach

Deep adaptive learning for safe and efficient navigation of pedestrian dynamics

Model-Free Learning of Corridor Clearance: A Near-Term Deployment Perspective

Modeling and Simulation of Crowd Pre-Evacuation Decision-Making in Complex Traffic Environments

Managing Mixed Traffic at Signalized Intersections: an Adaptive Signal Control and CAV Coordination System Based on Deep Reinforcement Learning.

Obstacle avoidance planning of autonomous vehicles using deep reinforcement learning

Demonstration-guided Deep Reinforcement Learning for Coordinated Ramp Metering and Perimeter Control in Large Scale Networks

Reinforcement learning for Pedestrian evacuation Simulation and Optimization during Pandemic and Panic situation

Deep reinforcement learning with a particle dynamics environment applied to emergency evacuation of a room with obstacles

Traffic Adaptive Control Framework for Real Time Large-Scale Emergency Evacuation

Coupled Simulation-Optimization Model for Pedestrian Evacuation Guidance Planning

Carbon Dioxide Emission Reduction-Oriented Optimal Control of Traffic Signals in Mixed Traffic Flow Based on Deep Reinforcement Learning