Abstract:In metro system, the fault of traction power supply system may cause the power supply shortage around the failure substation. In this case, the dispatching measure should be immediately taken to reduce the impacts of disruption on the train operation. To deal with this real-time traffic management problem, a cooperative control approach is proposed in this paper. In this approach, the time to apply tractive force and the level of force are simultaneously adjusted for all the operated trains, to maximize the maintained line capacity when considering the power supply capacity. Compared with the existing train timetable rescheduling approach, cooperative control is more flexible to get a better train regulation solution. To solve the challenges for developing the cooperative control model (i.e., undetermined number and dynamically changing of controlled objects), an imaginary section method is newly developed to transform the original problem into an equivalent cooperative control problem with fixed controlled objects. Then, the mathematical models for the transformed problem are constructed by using the space–time–speed network methodology. According to the formulated model, a Decentralized-Markov Decision Process (Dec-MDP) framework is designed as the basis of the applied algorithm. Next, a Collaboration Mechanism Based-Independent Deep Q-Network (CMB-IDQN) algorithm is proposed to solve the cooperative control problem. Compared with classical IDQN algorithm, a credit assignment method based on the collaboration mechanism among trains is novelly considered in the designed multi-agent reinforcement learning algorithm. Finally, the effectiveness of the proposed cooperative control approach is verified by two case studies. When solving the cooperative control problem, the performance by using CMB-IDQN algorithm can be increased by up to 13.0% and 16.8% compared with other two classical reinforcement learning algorithms (i.e., DQN and IDQN), respectively. Compared with two train timetable rescheduling measures during the power supply shortage, the cooperative control approach can improve the solution quality by more than 180.4% and 17.4%, respectively.

Integrated Rescheduling of Train Timetables and Rolling Stock Circulation for Metro Line Disturbance Management: a Q-learning-based Approach

Integrated train timetabling and rolling stock rescheduling for a disturbed metro system: A hybrid deep reinforcement learning and adaptive large neighborhood search approach

Real-time integrated train rescheduling and rolling stock circulation planning for a metro line under disruptions

Data-driven timetable design and passenger flow control optimization in metro lines

Integrated optimization of train timetables rescheduling and response vehicles on a disrupted metro line

A Multistage Decision Optimization Approach for Train Timetable Rescheduling Under Uncertain Disruptions in a High-Speed Railway Network

A real-time traffic rescheduling approach for the metro system

Train rescheduling for a metro circle line: a comparison of different response rules

Integrated Optimization on Train Control and Timetable to Minimize Net Energy Consumption of Metro Lines

Cooperative train control during the power supply shortage in metro system: A multi-agent reinforcement learning approach

Integrated Train Rescheduling and Rerouting during Multidisturbances under a Quasi-Moving Block System

A Collaborative Optimization Method for Train Scheduling and Passenger Flow Assignment Based on Multi-Agent Reinforcement Learning

Service-oriented train timetabling with collaborative passenger flow control on an oversaturated metro line: An integer linear optimization approach

Deep Reinforcement Learning for Integration of Train Trajectory Optimization and Timetable Rescheduling Under Disturbances

Robust collaborative passenger flow control on a congested metro line: A joint optimization with train timetabling

Integrated optimization of train route plan and timetable with dynamic demand for the urban rail transit line

Joint optimization of train timetabling and rolling stock circulation planning: A novel flexible train composition mode

Integrated optimization of urban rail transit line planning, timetabling and rolling stock scheduling

A data-driven mixed-integer linear programming approach for real-time rescheduling of urban rail transit under rolling stock faults

Passenger-oriented rolling stock scheduling in the metro system with multiple depots: Network flow based approaches

Resilience-Oriented Train Rescheduling Optimization in Railway Networks: A Mixed Integer Programming Approach