Abstract:Urban metros have become the foremost public transit to modern cities, carrying millions of daily rides. As travel efficiency matters to the work productivity of the city, shortening passengers’ travel time for metros is therefore a pressing need, which can bring substantial economic benefits. In this paper, we study a fine-grained, safe, and energy-efficient strategy to improve the efficiency of metro systems by dynamically scheduling dwell time for trains. However, developing such a strategy is very challenging because of three aspects: 1) The objective of optimizing the average travel time of passengers is complex, as it needs to properly balance passengers’ waiting time at platforms and journey time on trains, as well as considering long-term impacts on the whole metro system; 2) Capturing dynamic spatio-temporal (ST) correlations of incoming passengers for metro stations is difficult; and 3) For each train, the dwell time scheduling is affected by other trains on the same metro line, which is not easy to measure. To tackle these challenges, we propose a novel deep neural network, entitled AutoDwell. Specifically, AutoDwell optimizes the long-term rewards of dwell time settings in terms of passengers’ waiting time at platforms and journey time on trains by a reinforcement learning framework. Next, AutoDwell employs gated recurrent units and graph attention networks to extract the ST correlations of the passenger flows among metro stations. In addition, attention mechanisms are leveraged in AutoDwell for capturing the interactions between the trains on the same metro line. Extensive experiments on two real-world datasets collected from Beijing and Hangzhou, China, demonstrate the superior performance of AutoDwell over several baselines, capable of saving passengers’ overall travel time. In particular, the model can shorten the waiting time by at least 9%, which can boost passengers’ experience significantly.

MetroZero: Deep Reinforcement Learning and Monte Carlo Tree Search for Optimized Metro Network Expansion

City Metro Network Expansion with Reinforcement Learning

MetroGNN: Metro Network Expansion with Reinforcement Learning

Shortening Passengers’ Travel Time: A Dynamic Metro Train Scheduling Approach Using Deep Reinforcement Learning

A Collaborative Optimization Method for Train Scheduling and Passenger Flow Assignment Based on Multi-Agent Reinforcement Learning

Adaptive Metro Service Schedule and Train Composition With a Proximal Policy Optimization Approach Based on Deep Reinforcement Learning

Optimizing Transportation Dynamics at a City-Scale Using a Reinforcement Learning Framework

Designing Metro Network Expansion: Deterministic and Robust Optimization Models

Integrated train timetabling and rolling stock rescheduling for a disturbed metro system: A hybrid deep reinforcement learning and adaptive large neighborhood search approach

Real-Time Optimization of Urban Rail Transit Train Scheduling Via Advantage Actor–Critic Deep Reinforcement Learning

Mastering construction heuristics with self-play deep reinforcement learning

Routing optimization with Monte Carlo Tree Search-based multi-agent reinforcement learning

Learning Heuristics for Transit Network Design and Improvement with Deep Reinforcement Learning

Energy-saving Operation in Urban Rail Transit: A Deep Reinforcement Learning Approach with Speed Optimization

Dynamic Passenger Route Guidance in the Multimodal Transit System with Graph Representation and Attention Based Deep Reinforcement Learning

Optimizing Energy Efficiency in Metro Systems Under Uncertainty Disturbances Using Reinforcement Learning

Energy-saving design of underground metro vertical alignment with deep reinforcement learning

Learning to traverse over graphs with a Monte Carlo tree search-based self-play framework

Data-driven timetable design and passenger flow control optimization in metro lines

Integrated Optimization of Train Timetable, Rolling Stock Assignment and Short-Turning Strategy for a Metro Line