Abstract:An emergency responder management (ERM) system dispatches responders, such as ambulances, when it receives requests for medical aid. ERM systems can also proactively reposition responders between predesignated waiting locations to cover any gaps that arise due to the prior dispatch of responders or significant changes in the distribution of anticipated requests. Optimal repositioning is computationally challenging due to the exponential number of ways to allocate responders between locations and the uncertainty in future requests. The state-of-the-art approach in proactive repositioning is a hierarchical approach based on spatial decomposition and online Monte Carlo tree search, which may require minutes of computation for each decision in a domain where seconds can save lives. We address the issue of long decision times by introducing a novel reinforcement learning (RL) approach, based on the same hierarchical decomposition, but replacing online search with learning. To address the computational challenges posed by large, variable-dimensional, and discrete state and action spaces, we propose: (1) actor-critic based agents that incorporate transformers to handle variable-dimensional states and actions, (2) projections to fixed-dimensional observations to handle complex states, and (3) combinatorial techniques to map continuous actions to discrete allocations. We evaluate our approach using real-world data from two U.S. cities, Nashville, TN and Seattle, WA. Our experiments show that compared to the state of the art, our approach reduces computation time per decision by three orders of magnitude, while also slightly reducing average ambulance response time by 5 seconds.

A Study of Aeromedical Emergency Scheduling Based on a Collaborative Difference Algorithm Improved by Reinforcement Learning

Deep Reinforcement Learning-Based Autonomous Mission Planning Method for High and Low Orbit Multiple Agile Earth Observing Satellites

Coordinating Disaster Emergency Response with Heuristic Reinforcement Learning

A dynamic task assignment model for aviation emergency rescue based on multi-agent reinforcement learning

SCHEDULING ALGORITHM BASED ON FOLLOW-UP SHARING CHARACTER FOR POST-EVENT RESPONSE RESOURCE DISTRIBUTION IN LARGE-SCAL DISASTERS

Deep Reinforcement Learning Enabled Multi-UAV Scheduling for Disaster Data Collection With Time-Varying Value

Deep Q networks-based optimization of emergency resource scheduling for urban public health events

Simulation Study of Aviation Emergency Rescue Process Based on Application Scenario Features

Reinforcement learning approach for resource allocation in humanitarian logistics

Integrated Emergency Vehicle Scheduling Model in Urban Emergency Rescue Within a Time-Limited Period

Learning-to-Dispatch: Reinforcement Learning Based Flight Planning under Emergency

Collaborative Scheduling of Mass Rescue Operations at Sea

Multi-Agent Reinforcement Learning with Hierarchical Coordination for Emergency Responder Stationing

A Fast Approach to Satellite Range Rescheduling Using Deep Reinforcement Learning

Resource Scheduling Based on Deep Reinforcement Learning in UAV Assisted Emergency Communication Networks

Large-scale dynamic surgical scheduling under uncertainty by hierarchical reinforcement learning

Teleconsultation dynamic scheduling with a deep reinforcement learning approach

Deep Reinforcement Learning-Based Rescue Resource Distribution Scheduling of Storm Surge Inundation Emergency Logistics

A Drone Scheduling Method for Emergency Power Material Transportation Based on Deep Reinforcement Learning Optimized PSO Algorithm

Adaptive task migration strategy with delay risk control and reinforcement learning for emergency monitoring

Research on Collaborative and Optimal Deployment and Decision Making Among Major Geological Disaster Rescue Subjects