Abstract:Selective maintenance, which aims to choose a subset of feasible maintenance actions to be performed for a repairable system with limited maintenance resources, has been extensively studied over the past decade. Most of the reported works on selective maintenance have been dedicated to maximizing the success of a single future mission. Cases of multiple consecutive missions, which are oftentimes encountered in engineering practices, have been rarely investigated to date. In this paper, a new selective maintenance optimization for multi-state systems that can execute multiple consecutive missions over a finite horizon is developed. The selective maintenance strategy can be dynamically optimized to maximize the expected number of future mission successes whenever the states and effective ages of the components become known at the end of the last mission. The dynamic optimization problem, which accounts for imperfect maintenance, is formulated as a discrete-time finite-horizon Markov decision process with a mixed integer-discrete-continuous state space. Based on the framework of actor-critic algorithms, a customized deep reinforcement learning method is put forth to overcome the "curse of dimensionality" and mitigate the uncountable state space. In our proposed method, a postprocess is developed for the actor to search the optimal maintenance actions in a large-scale discrete action space, whereas the techniques of the experience replay and the target network are utilized to facilitate the agent training. The performance of the proposed method is examined by an illustrative example and an engineering example of a coal transportation system. (C) 2019 Elsevier B.V. All rights reserved.

Integrated Selective Maintenance and Task Assignment Optimization for Multi-State Systems Executing Multiple Missions

Selective Maintenance Strategy for Systems Executing Multiple Consecutive Missions with Uncertainty.

Optimal Selective Maintenance Strategy for Multi-State Systems Under Imperfect Maintenance

Selective Maintenance for Systems Operating Multiple Consecutive Missions

Selective Maintenance Optimization for a Multi-State System Considering Human Reliability

Selective Maintenance for Multi-state Systems with Loading Strategy

Dynamic Selective Maintenance for Multi-state Systems Operating Multiple Consecutive Missions

Optimal Selective Maintenance Decision-Making for Consecutive-Mission Systems with Variable Durations and Limited Maintenance Time

Dynamic Selective Maintenance Optimization for Multi-State Systems over a Finite Horizon: A Deep Reinforcement Learning Approach.

Selective Maintenance Optimization for Fuzzy Multi-State Systems

Selective Maintenance Optimisation Considering Random Common Cause Failures and Imperfect Maintenance

Selective maintenance for multi-state series–parallel systems under economic dependence

Selective maintenance of multi-state systems with structural dependence

Knowledge Transfer-Based Multifactorial Evolutionary Algorithm for Selective Maintenance Optimization of Multistate Complex Systems

Scheduling Heterogeneous Repair Channels in Selective Maintenance of Multi-State Systems with Maintenance Duration Uncertainty

Selective Maintenance for Multi-state Systems Under Imperfect Maintenance

Selective Maintenance under Stochastic Time Durations of Breaks and Maintenance Actions

Joint Optimization of Fleet-Level Sequential Selective Maintenance and Repairpersons Assignment for Multi-State Manufacturing Systems

Optimal Load Distribution For Multi-State Systems Under Selective Maintenance Strategy

Optimal maintenance strategy for multi-state systems with single maintenance capacity and arbitrarily distributed maintenance time

Selective Maintenance Optimization under Limited Maintenance Capacities: A Machine Learning-Enhanced Approximate Dynamic Programming