Adaptive Reinforcement Learning Model for Simulation of Urban Mobility during Crises

Chao Fan,Xiangqi Jiang,Ali Mostafavi

DOI: https://doi.org/10.48550/arXiv.2009.01359

2020-09-03

Abstract:The objective of this study is to propose and test an adaptive reinforcement learning model that can learn the patterns of human mobility in a normal context and simulate the mobility during perturbations caused by crises, such as flooding, wildfire, and hurricanes. Understanding and predicting human mobility patterns, such as destination and trajectory selection, can inform emerging congestion and road closures raised by disruptions in emergencies. Data related to human movement trajectories are scarce, especially in the context of emergencies, which places a limitation on applications of existing urban mobility models learned from empirical data. Models with the capability of learning the mobility patterns from data generated in normal situations and which can adapt to emergency situations are needed to inform emergency response and urban resilience assessments. To address this gap, this study creates and tests an adaptive reinforcement learning model that can predict the destinations of movements, estimate the trajectory for each origin and destination pair, and examine the impact of perturbations on humans' decisions related to destinations and movement trajectories. The application of the proposed model is shown in the context of Houston and the flooding scenario caused by Hurricane Harvey in August 2017. The results show that the model can achieve more than 76\% precision and recall. The results also show that the model could predict traffic patterns and congestion resulting from to urban flooding. The outcomes of the analysis demonstrate the capabilities of the model for analyzing urban mobility during crises, which can inform the public and decision-makers about the response strategies and resilience planning to reduce the impacts of crises on urban mobility.

Physics and Society,Computers and Society

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the lack of ability to simulate urban population flow patterns in crisis situations (such as floods, wildfires and hurricanes). Specifically, existing urban mobility models are mainly based on empirical data in normal situations, and these data are often not applicable or unavailable in emergency situations. Therefore, a model that can learn human movement patterns from data in normal situations and adapt to emergency situations is needed to predict destination selection and movement trajectories and evaluate the impact of crises on human decision - making. To meet this challenge, this research developed and tested an adaptive reinforcement learning model, which can learn the movement patterns of individuals in normal situations and simulate changes in movement trajectories and traffic patterns in crisis scenarios, thus providing support for emergency response and urban resilience assessment. By using the data of Houston in 2017, especially the flood scenario during Hurricane Harvey, the paper demonstrated the application and performance of the proposed model. The results showed that the model can achieve a precision rate and a recall rate of more than 76%, can predict traffic patterns and traffic congestion caused by urban floods, proving its potential in analyzing urban mobility during crises. This provides the public and decision - makers with information on response strategies and resilience planning to reduce the impact of crises on urban mobility.

Adaptive Reinforcement Learning Model for Simulation of Urban Mobility during Crises

Modeling Real-Time Human Mobility Based on Mobile Phone and Transportation Data Fusion

Predicting Human Mobility Flows in Response to Extreme Urban Floods: A Hybrid Deep Learning Model Considering Spatial Heterogeneity

Deep reinforcement learning for optimal rescue path planning in uncertain and complex urban pluvial flood scenarios

Forecasting Road Network Functionality States During Extreme Rainfall Events to Facilitate Real-Time Emergency Response Planning

Integrated modeling of urban mobility, flood inundation, and sewer hydrodynamics processes to support resilience assessment of urban drainage systems

Real-Time Flood Disaster Prediction System by Applying Machine Learning Technique

Rescue path planning for urban flood: A deep reinforcement learning-based approach

STFS-urban: Spatio-temporal flood simulation model for urban areas

Enhancing flood risk assessment in urban areas by integrating hydrodynamic models and machine learning techniques

Flood evacuation simulations using cellular automata and multiagent systems -a human-environment relationship perspective

A-RESCUE: An Agent based Regional Evacuation Simulator Coupled with User Enriched Behavior

Climate Adaptation with Reinforcement Learning: Experiments with Flooding and Transportation in Copenhagen

Evaluating the flooding level impacts on urban metro networks and travel demand: behavioral analyses, agent-based simulation, and large-scale case study

A Simulator of Human Emergency Mobility Following Disasters: Knowledge Transfer from Big Disaster Data

Learning to Simulate Human Mobility

Improving the Urban Transport System Resilience Through Adaptive Traffic Signal Control Enabled by Decentralised Multiagent Reinforcement Learning

A Rapid Prediction Model of Urban Flood Inundation in a High-Risk Area Coupling Machine Learning and Numerical Simulation Approaches

Urban Flood Risk Assessment through the Integration of Natural and Human Resilience Based on Machine Learning Models

Strategizing Equitable Transit Evacuations: A Data-Driven Reinforcement Learning Approach

DeepUrbanMomentum: An Online Deep-Learning System for Short-Term Urban Mobility Prediction