Abstract:The new railway mobility paradigm Virtual Coupling, recognized as one of the most promising solutions to face the ever-increasing demand in railway transportation and the saturation of network capacity, enables two or more trains to virtually couple in a single convoy, hence reducing the headway among them. Within this context, the design of an effective and robust Virtual Coupling control strategy for uncertain nonlinear heterogeneous train convoys, able to simultaneously cope with uncertain nonlinearities and unexpected/unpredictable external factors, is an open challenge in the railway field. This is very crucial for High-Speed Trains, where, due to the high-speed operating ranges, uncertain factors have a stronger impact on Virtual Coupling performance. To deal with this issue, this work exploits the ability of Deep Reinforcement Learning based strategies in defining an optimal control policy via an iterative exploration of the surrounding unknown environment and without detailed knowledge of the plant dynamics. Specifically, we propose a novel Deep Deterministic Policy Gradient based control strategy to coordinate and manage the High-Speed Trains convoy such that this latter can autonomously adapt its behaviour to all the encountered driving scenarios. The effectiveness of the proposed approach is evaluated via simulation analyses, carried-out via an ad-hoc implemented Virtual Coupling Train System simulation platform. After verifying the efficiency of the training process in ensuring the fulfilment of the Virtual Coupling control objectives, extensive non-trivial simulations, also involving cooperative manoeuvres, are performed for the validation phase. Results confirm how the proposed model-free Deep Deterministic Policy Gradient approach guarantees the Virtual Coupling for nonlinear heterogeneous High-Speed Train convoys despite the co-presence of uncertainties and unknown external factors. Finally, the advantages and the benefits of the proposed data-driven control are disclosed via a comparison analysis against model-based control strategies.

Hybrid Model Predictive Control for Virtual Coupling of Heavy-haul Trains

Iterative Learning Tracking Control of High-Speed Trains with Nonlinearly Parameterized Uncertainties and Multiple Time-Varying Delays

Distributed Model Predictive Control for Vehicle Platoon With Mixed Disturbances and Model Uncertainties

Long Short-Term Memory-Based Model Predictive Control for Virtual Coupling in Railways

Integrated Motion and Powertrain Predictive Control of Intelligent Fuel Cell/Battery Hybrid Vehicles

Emission Mitigation Via Longitudinal Control of Intelligent Vehicles in A Congested Platoon

A Nonlinear Safety Equilibrium Spacing-Based Model Predictive Control for Virtually Coupled Train Set over Gradient Terrains

Cruising Control Approach for Virtually Coupled Train Set Based on Model Predictive Control

Cooperative Reference Velocity Regulation Control for Virtual Coupling Systems of Heavy-Haul Trains

An adaptive safety control approach for virtual coupling system with model parametric uncertainties

Synthesis of dynamic modelling framework and optimal control strategy for virtually coupled train sets with guaranteed safety

Distributed Robust Model Predictive Control for Virtual Coupling Under Structural and External Uncertainty

Research on Train Dynamic Coupling Strategy Based on Distributed Model Predictive Control

Distributed adaptive coordinative control for virtually coupled train set with considering parametric uncertainty and state constraints

An optimal scheduling method for heavy haul trains with virtual coupling technology

Adaptive Cruise Control of Virtual Coupled Trains Based on Sliding Mode

Deep Deterministic Policy Gradient Virtual Coupling control for the coordination and manoeuvring of heterogeneous uncertain nonlinear High-Speed Trains

A Stabilized Virtual Coupling Scheme for a Train Set with Heterogeneous Braking Dynamics Capability

Optimal control of intelligent vehicle longitudinal dynamics via hybrid model predictive control

Coordinated Control Method of Virtually Coupled Train Formation Based on Multi Agent System

Cooperative control of virtually coupled trains considering train-to-train communication cycle: a tube-based model predictive control approach