Abstract:Railway maintenance is a complex and complicated task in the railway industry due to the number of its components and relationships. Ineffective railway maintenance results in excess cost, defective railway structure and components, longer possession time, poorer safety, and lower passenger comfort. Of the three main maintenance approaches, predictive maintenance is the trendy one, and is proven that it provides the highest efficiency. However, the implementation of predictive maintenance for the railway industry cannot be done without an efficient tool. Normally, railway maintenance is corrective when some things fail or preventive when maintenance is routine. A novel approach using an integration between deep reinforcement learning and digital twin is proposed in this study to improve the efficiency of railway maintenance which other techniques such as supervised and unsupervised learning cannot provide. In the study, Advantage Actor Critic (A2C) is used to develop a reinforcement learning model and agent to fulfill the need of the study. Real-world field data over four years and 30 km. is obtained and applied for developing the reinforcement learning model. Track geometry parameters, railway component defects, and maintenance activities are used as parameters to develop the reinforcement learning model. Rewards (or penalties) are calculated based on maintenance costs and occurring defects. The new breakthrough exhibits that using reinforcement learning integrated with digital twin can reduce maintenance activities by 21% and reduce the occurring defects by 68%. Novelties of the study are the use of A2C which is faster and provides better results than other traditional techniques such as Deep Q-learning (DQN), each track geometry parameter is considered without combining into a track quality index, filed data are used to develop the reinforcement learning model, and seven independent actions are included in the reinforcement learning model. This study is the world's first to contribute a new guideline for applying reinforcement learning and digital twins to improve the efficiency of railway maintenance, reduce the number of defects, reduce the maintenance cost, reduce the possession time for railway maintenance, improve the overall safety of the railway operation, and improve the passenger comfort which can be seen from its results.

Integrating AI and DTs: challenges and opportunities in railway maintenance application and beyond

Digitalization of railway transportation through AI-powered services: digital twin trains

A literature review of Artificial Intelligence applications in railway systems

Advancements and applications of digital twin in the railway industry: a literature review

State-of-the-Art Review: The Use of Digital Twins to Support Artificial Intelligence-Guided Predictive Maintenance

Research on Digital Twin Technology and Its Application in Intelligent Operation and Maintenance of High-Speed Railway Infrastructure

Digital twins in safety analysis, risk assessment and emergency management

A Human-Centric Model for Sustainable Asset Management in Railway: A Case Study

A Survey on AI-Driven Digital Twins in Industry 4.0: Smart Manufacturing and Advanced Robotics

Towards digital twin trains: implementing a cloud-based framework for railway vehicle dynamics simulation

A literature review on the applications of artificial intelligence to European rail transport safety

Artificial intelligence and digital twins in power systems: Trends, synergies and opportunities

Digital Twin Approach for Operation and Maintenance of Transportation System—Systematic Review

Railway infrastructure maintenance efficiency improvement using deep reinforcement learning integrated with digital twin based on track geometry and component defects

Digital Twins for Managing Railway Bridge Maintenance, Resilience, and Climate Change Adaptation

Towards Transportation Digital Twin Systems for Traffic Safety and Mobility Applications: A Review

The Interplay of AI and Digital Twin: Bridging the Gap between Data-Driven and Model-Driven Approaches

Robotic Railway Multi-Sensing and Profiling Unit Based on Artificial Intelligence and Data Fusion

Digital Twin in Industry: State-of-the-Art

Integration of Railway Bridge Structural Health Monitoring into the Internet of Things with a Digital Twin: A Case Study

A simulation-based digital twin for data-driven maintenance scheduling of risk-prone production lines via actor critics