Abstract:The combination of multi-agent technology and reinforcement learning methods has been recognized as an effective way which is used in path planning-based crowd simulation. However, the existing solution is still not satisfactory due to the problem in the mutual influence of agents. Therefore, an improved multi-agent reinforcement learning method (IMARL algorithm) is introduced. In this method, the intersection of the pedestrian trajectory extracted from the real video is first used as the state space for reinforcement learning. The crowd is grouped and the leader is selected. A bulletin board is added to the reinforcement learning algorithm of multi-agent to store the empirical knowledge of the learning process, and the navigation agent passes information between the leader and the bulletin board. The original social force model was improved, and the cohesive force of visual factors was added to the force formula. The IMARL algorithm is combined with the improved social force model for crowd evacuation simulation. Using a two-layer control mechanism, the leader in the upper layer uses the decision process based on the IMARL algorithm to select the path, and the individuals in the bottom group use the improved social force model to evacuate. The method of this paper not only solves the dimensionality disaster problem of reinforcement learning but also improves the convergence speed. The evacuation efficiency is effectively improved in crowd evacuation simulation experiments. In addition, it can also provide specific guidance scheme for crowd evacuation improvement and assistant decision support for the prevention and management of large-scale group trampling incidents.

Multi-stage Dynamic Coordination Model for Large-Scale Crowd's Activities Based on Multi-agent

Visitors＇ Dynamic Coordination Research for Large-Scale Crowd＇s Activities

Visitors Coordination Control Methods in Large-Scale Exhibition Based on Multi-Agent

Route Guidance Mechanism with Centralized Information Control in Large-scale Crowd's Activities

Visitors' Coordination for World Expo 2010 Shanghai

A Network Optimization-Based Approach for Crowd Management in Large Public Gatherings

Guide Them Through: an Automatic Crowd Control Framework Using Multi-Objective Genetic Programming

A distributed algorithm for signal coordination of multiple agents with embedded platoon dispersion model

Multi Mobile Agent Itinerary Planning Based on Network Coverage and Multi-Objective Discrete Social Spider Optimization Algorithm

Dynamic Public Resource Allocation Based on Human Mobility Prediction.

Analysis of Crowd Behavior in Route Choice Based on Dynamic Programming

Coordination based on Multi-Agent and its application of urban intersection traffic coordination control

A coordinated scheduling approach for task assignment and multi-agent path planning

A Game Coordination Optimization Algorithm

Mathematical Modeling of Command-And-Control Strategies in Crowd Movement

Reinforcement Learning for Crowd Control Optimization with An A* Based Social Force Interaction Model

Crowd Evacuation Planning Using Cartesian Genetic Programming and Agent-Based Crowd Modeling

A Data-Driven Urban Metro Management Approach for Crowd Density Control

ActiveCrowd: A Framework for Optimized Multi-Task Allocation in Mobile Crowdsensing Systems

Multi-Agent Coverage Path Planning via Proximity Interaction and Cooperation

Improved Multi-Agent Reinforcement Learning for Path Planning-Based Crowd Simulation