Abstract:For walking pedestrians, when they are blocked by obstacles or other pedestrians, they adjust their speeds and directions to avoid colliding with them, which is called collision avoidance behavior. This behavior is the most complex part of pedestrians' walking processes and its modeling and simulation are the keys to realistic crowd simulation, which serves as the foundation for various applications. However, most existing methods either lack the representation power to accurately model the complex collision behavior or do not model it explicitly, which leads to a poor level of realism of the simulation. To realize realistic crowd simulation, we propose to analyze, understand, and model the collision avoidance behavior in a data-driven way. First, to automatically detect collision avoidance behavior for further analysis, we propose a domain transformation algorithm that detects it by transforming the trajectories in the spatial domain into a new domain where the behavior is much more apparent and is thus easier to detect. The new domain also provides a new perspective for understanding collision avoidance behavior. Second, since there are no mature metrics to evaluate the level of realism, we propose a new evaluation metric based on the least-effort theory, which evaluates the realism of collision avoidance behavior by its physical and mental consumption. This evaluation metric also provides the foundation of modeling. Third, for realistic crowd simulation, we design a reinforcement learning model. It trains agents with our proposed reward function that models pedestrians' intrinsic needs of "reducing effort consumption'' and thus can guide agents to behave realistically when avoiding collisions. Extensive experiments show our model is 55.9% and 52.5% more realistic in collision avoidance behavior than the best baselines on two real-world datasets. We release our codes at https://github.com/tsinghua-fib-lab/TECRL.

Reinforcement Learning for Crowd Control Optimization with An A* Based Social Force Interaction Model

Pedestrians’ behavior in emergency evacuation: Modeling and simulation*

Path optimization of integrating crowd model and reinforcement learning.

Improved Multi-Agent Reinforcement Learning for Path Planning-Based Crowd Simulation

Crowd Management Through Optimal Layout of Fences: An Ant Colony Approach Based on Crowd Simulation

Mathematical Modeling of Command-And-Control Strategies in Crowd Movement

A Network Optimization-Based Approach for Crowd Management in Large Public Gatherings

A Force-Based Model for Adaptively Controlling the Spatial Configuration of Pedestrian Subgroups at Non-Extreme Densities

Enhanced Crowd Dynamics Simulation with Deep Learning and Improved Social Force Model

Modeling and Optimization of Collaborative Passenger Control in Urban Rail Stations under Mass Passenger Flow

Urban Traffic Light Control Via Active Multi-Agent Communication and Supply-Demand Modeling

A Collaborative Optimization Method for Train Scheduling and Passenger Flow Assignment Based on Multi-Agent Reinforcement Learning

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

Cooperative traffic signal control through a counterfactual multi-agent deep actor critic approach

Understanding and Modeling Collision Avoidance Behavior for Realistic Crowd Simulation

A Reinforcement Learning-based Adaptive Control Model for Future Street Planning, An Algorithm and A Case Study

Time-to-Collision Based Social Force Model for Intelligent Agents on Shared Public Spaces

Optimizing Traffic Efficiency Via a Reinforcement Learning Approach Based on Time Allocation

Continuous agent-based modeling of adult-child pairs based on a pseudo-energy: Relevance for public safety and egress efficiency

Batch-Augmented Multi-Agent Reinforcement Learning for Efficient Traffic Signal Optimization

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections