Abstract:Energy-efficient operation of trains in subway systems is regarded as one of the most effective strategies to cut down the operational cost. Most of the studies about the energy-efficient operation of trains aim to minimize the consumption of mechanical energy of trains. In this paper, an energy-efficient train control model is proposed under the practical billing system by introducing the traction efficiency. In addition, a numerical solution approach is presented to solve the energy-efficient driving strategy, which consists of the control sequences and the corresponding switching points. First, the authors analyze the energy-efficient control problem by applying the maximum principle, from which the energy-efficient control regime is proved to include the maximum acceleration, coasting, cruising with partial braking, and maximum braking. Second, the control sequences for one section are fully analyzed and an algorithm is presented to calculate the switching points with the energy consumption constraint. To obtain the solution to an interval with variable speed limits and gradients, the interval is divided into several sections, where the gradient and speed limit of each section are constants. A primary energy-efficient solution, which costs a longer trip time, is given. Then, energy units are assigned into multiple sections to shorten the trip time of the primary solution. Specifically, each energy unit is added into the selected section to achieve the maximum time reduction. Finally, the energy-efficient driving strategy at all sections will be obtained when the scheduled trip time of the interval is delivered. Some examples based on the practical data are conducted to illustrate that the proposed approach has a good potential on saving energy of trains.

Energy-efficient train control method based on soft actor-critic algorithm.

A Data-Driven Iterative Learning Approach for Optimizing the Train Control Strategy

A DQN-based Approach for Energy-Efficient Train Driving Control

ACDRL: An actor–critic deep reinforcement learning approach for solving the energy-aimed train timetable rescheduling problem under random disturbances

A Soft Actor-Critic-based Energy Management Strategy for Electric Vehicles with Hybrid Energy Storage Systems

An eco-driving algorithm for trains through distributing energy: A Q-Learning approach

Energy-efficient Operation by Cooperative Control among Trains: A Multi-Agent Reinforcement Learning Approach

Energy Management for Electrified Tracked Vehicles Via Improved Soft Actor-Critic Algorithm

Deep Reinforcement Learning with Reference System to Handle Constraints for Energy-Efficient Train Control

Integrated Optimization on Train Control and Timetable to Minimize Net Energy Consumption of Metro Lines

Energy-saving Operation in Urban Rail Transit: A Deep Reinforcement Learning Approach with Speed Optimization

Smart Energy Management for Hybrid Electric Bus Via Improved Soft Actor-Critic Algorithm in a Heuristic Learning Framework

A Deep Reinforcement Learning Approach for the Energy-Aimed Train Timetable Rescheduling Problem Under Disturbances

Deep Reinforcement Learning for Energy-efficient Train Operation of Automatic Driving

Driving Strategy Optimization for Trains in Subway Systems

Energy Management of a Plug-in Hybrid Electric Vehicle Using Bayesian Optimization and Soft Actor-Critic Algorithm

An Energy-Efficient Control Algorithm and Simulation of Urban Rail Transit Systems

Application of a Deep Deterministic Policy Gradient Algorithm for Energy-Aimed Timetable Rescheduling Problem

Research on Adaptive Cruise Control Based on Soft Actor-Critic Algorithm

An improved soft actor-critic-based energy management strategy of heavy-duty hybrid electric vehicles with dual-engine system

Energy-Saving Train Operation Synergy Based on Multi-Agent Deep Reinforcement Learning on Spark Cloud