Optimizing Energy Efficiency in Metro Systems Under Uncertainty Disturbances Using Reinforcement Learning

Haiqin Xie,Cheng Wang,Shicheng Li,Yue Zhang,Shanshan Wang
2023-05-17
Abstract:In the realm of urban transportation, metro systems serve as crucial and sustainable means of public transit. However, their substantial energy consumption poses a challenge to the goal of sustainability. Disturbances such as delays and passenger flow changes can further exacerbate this issue by negatively affecting energy efficiency in metro systems. To tackle this problem, we propose a policy-based reinforcement learning approach that reschedules the metro timetable and optimizes energy efficiency in metro systems under disturbances by adjusting the dwell time and cruise speed of trains. Our experiments conducted in a simulation environment demonstrate the superiority of our method over baseline methods, achieving a traction energy consumption reduction of up to 10.9% and an increase in regenerative braking energy utilization of up to 47.9%. This study provides an effective solution to the energy-saving problem of urban rail transit.
Artificial Intelligence,Systems and Control
What problem does this paper attempt to address?
### The Problem This Paper Attempts to Solve This paper aims to address the issue of energy efficiency optimization in metro systems under uncertain disturbances. Specifically: 1. **Problem Background**: - As a crucial part of urban transportation, the massive energy consumption of metro systems poses a challenge to sustainable development goals. - Uncertain factors (such as delays, changes in passenger flow, etc.) further reduce the energy efficiency of metro systems. 2. **Insufficiencies of Existing Methods**: - Traditional fixed timetable methods (Energy-Efficient Train Timetabling, EETT) can reduce operational energy consumption but are ineffective in the face of unexpected situations. - Train Timetable Rescheduling (TTR) is flexible but requires advanced control algorithms to adjust train timetables in real-time. 3. **Solution**: - A reinforcement learning method based on Proximal Policy Optimization (PPO) is proposed to dynamically adjust the stopping time and cruising speed of metro trains, thereby optimizing energy efficiency in the presence of uncertainties. - Experimental results show that this method can significantly reduce traction energy consumption and improve the utilization rate of regenerative braking energy. Through this method, the paper proposes an effective solution to the energy-saving problem of urban rail transit.