Abstract:Cyclic air braking is a key element for ensuring safe train operation when running on a long and steep downhill railway section. In reality, the cyclic braking performance of a train is affected by its operating environment, speed and air-refilling time. Existing optimization algorithms have the problem of low learning efficiency. To solve this problem, an intelligent control method based on the deep Q-network (DQN) algorithm for heavy-haul trains running on long and steep downhill railway sections is proposed. Firstly, the environment of heavy-haul train operation is designed by considering the line characteristics, speed limits and constraints of the train pipe's air-refilling time. Secondly, the control process of heavy-haul trains running on long and steep downhill sections is described as the reinforcement learning (RL) of a Markov decision process. By designing the critical elements of RL, a cyclic braking strategy for heavy-haul trains is established based on the reinforcement learning algorithm. Thirdly, the deep neural network and Q-learning are combined to design a neural network for approximating the action value function so that the algorithm can achieve the optimal action value function faster. Finally, simulation experiments are conducted on the actual track data pertaining to the Shuozhou–Huanghua line in China to compare the performance of the Q-learning algorithm against the DQN algorithm. Our findings revealed that the DQN-based intelligent control strategy decreased the air braking distance by 2.1% and enhanced the overall average speed by more than 7%. These experiments unequivocally demonstrate the efficacy and superiority of the DQN-based intelligent control strategy.

Heavy-load train model based on RBF neural network refers to the adaptive brake control strategy

Nonlinear adaptive control based on RBF networks and multi-model method

A Nonlinear Adaptive Controller Based on RBF Networks

Research on Modeling and Load Simulation Algorithm of Tracked Vehicle Braking System on Mu-Split Road Surfaces

Research on the air brake system of heavy haul trains based on neural network

Fully Automatic Operation Algorithm of Urban Rail Train Based on RBFNN Position Output Constrained Robust Adaptive Control

A novel aircraft brake disturbance recognition model

Deep Q-Network Algorithm-Based Cyclic Air Braking Strategy for Heavy-Haul Trains

Research on Control Strategy of Heavy-Haul Train on Long and Steep Downgrades

Support Vector Regression Based Nonlinear Model Reference Adaptive Control

Adaptive Nonsingular Fast Terminal Sliding Mode Control For Braking Systems With Electro-Mechanical Actuators Based On Radial Basis Function

Optimization of Urban Rail Automatic Train Operation System Based on RBF Neural Network Adaptive Terminal Sliding Mode Fault Tolerant Control

A Study on the Vehicle Antilock System Based on Adaptive Neural Network Sliding Mode Control

Model identification and nonlinear adaptive control of suspension system of high-speed maglev train

Sliding Mode Control for Driving and Regenerative Braking of Electric Vehicle Based on RBF Neural Network

Data-based fault-tolerant control of high-speed trains with traction/braking notch nonlinearities and actuator failures

Influence of Cyclic Pneumatic Brake on the Longitudinal Dynamics of Heavy-Haul Combined Trains

RBF Neural Network Control Strategy for Dynamic Load Simulator

Nonlinear Reconfigurable Control Based on RBF Neural Networks

Adaptive neural network control of pneumatic servo system considering state constraints

Neural adaptive dynamic surface control of an electro-hydraulic loading system for rail grinders