Abstract:Efficiently optimizing maintenance strategies is vital for the cost reduction of complex equipment. Most of the current research in this domain primarily focuses on single-objective optimization, often centered on cost-based approaches. However, this approach may not be sufficient for complex equipment like aero-engines, which operate in complex conditions and exhibit nonlinear degradation, posing significant reliability challenges. To tackle this issue, a multi-objective optimization problem (MOP) has been formulated and solved in this study, encompassing models for both maintenance cost and reliability. The optimization of multiple objectives involves employing a decomposition strategy that amalgamates these objectives into a unified single objective. Additionally, the training process is expedited through the utilization of a neighborhood-based parameter-transfer strategy. The approach represents the development of a maintenance framework that seamlessly integrates the decomposition strategy, the neighborhood-based parameter-transfer strategy, and deep reinforcement learning (DRL). Notably, this framework eliminates the need for predetermined maintenance thresholds and predefined weights for various objectives, effectively overcoming the overconfidence typically observed in DRL during single-objective optimization. Applying this framework to the optimization of aero-engine maintenance strategies that take economic dependence into account, cost reductions of up to 16.7% were achieved compared to traditional baseline maintenance strategies. It is proved that the proposed method can reduce maintenance costs while ensuring reliability, and can adapt to dynamic changes in the environment.

Q-learning based maintenance decision of missile single component

Reinforcement learning-driven maintenance strategy: A novel solution for long-term aircraft maintenance decision optimization

Optimal Selective Maintenance Decision-Making for Consecutive-Mission Systems with Variable Durations and Limited Maintenance Time

Dynamic Selective Maintenance for Multi-state Systems Operating Multiple Consecutive Missions

A Deep Reinforcement Learning Approach for Maintenance Planning of Multi-Component Systems with Complex Structure

Real-time prediction of remaining useful life and preventive opportunistic maintenance strategy for multi-component systems considering stochastic dependence

Health Status-Based Predictive Maintenance Decision-Making via LSTM and Markov Decision Process

Life Prediction of Carrier-Based Aircraft Replaceable Units With Time-Varying Drift and Optimization Strategy for Imperfect Maintenance

Dynamic Selective Maintenance Optimization for Multi-State Systems over a Finite Horizon: A Deep Reinforcement Learning Approach.

Selective Maintenance Strategy for Systems Executing Multiple Consecutive Missions with Uncertainty.

A maintenance strategy based on system reliability considering imperfect corrective maintenance and shocks

Opportunistic preventive maintenance strategy of a multi-component system with hierarchical structure by simulation and evaluation

Condition-based maintenance assessment for a deteriorating system considering stochastic failure dependence

Deep learning-based intelligent multilevel predictive maintenance framework considering comprehensive cost

Deep Reinforcement Learning for Maintenance Optimization of Multi-Component Production Systems Considering Quality and Production Plan

Condition-based maintenance method for multi-component systems under discrete-state condition: Subsea production system as a case

Overall Solution of Comprehensive Evaluation for Missile Storage Life

A Predictive Maintenance Strategy Using Deep Learning Quantile Regression and Kernel Density Estimation for Failure Prediction

Reinforcement Learning in Reliability and Maintenance Optimization: A Tutorial

Maintenance optimisation of multi-unit balanced systems using deep reinforcement learning

A deep reinforcement learning-driven multi-objective optimization and its applications on aero-engine maintenance strategy