Abstract:This paper studies how to model and resolve the dynamic maintenance problem for the continuous degrading system. The main objective is to realize the maintenance cost optimization and determine the optimal maintenance action in the real-time degradation system. First, a deterioration model based on the Wiener process with Brownian motion is described to simulate the deterioration system and estimate the deterioration level. Second, a data-processing method is applied to discretize the continuous degradation into the discrete degradation state. Thus, a discrete-time finite Markov decision process (MDP) model is established to describe the maintenance decision processes. Third, a dynamic maintenance decision framework is constructed by periodic status monitoring and a customized deep reinforcement learning method. The developed decision framework determines the maintenance action by utilizing the specific degradation state at each inspection stage. Fourth, a maintenance decision agent is developed by employing a customized proximal policy optimization with an entropy regularization approach to solve the dynamic maintenance problem, in which the deep actor- critic networks, advantage function estimation method, truncated surrogate approach, and entropy regularization approach are integrated to facilitate the policy optimization processes, and the customized maintenance decision approach is also verified by simulation analysis. To illustrate the effectiveness, comparison studies are conducted and the results demonstrate that: (i) the cumulative maintenance costs are decreased and approaching the approximated equilibrium state by running the proposed maintenance decision algorithm; (ii) the proposed customized deep reinforcement learning approach for the maintenance decision problem can be implemented easily, and the efficiency and stability can be enhanced distinctively; (iii) the proposed maintenance framework can provide a useful decision tool for engineering manager.

A maintenance policy for a deteriorating system under epistemic uncertainty

A Condition-Based Replacement and Spare Provisioning Policy for Deteriorating Systems with Uncertain Deterioration to Failure.

An Optimum Condition-Based Replacement And Spare Provisioning Policy Based On Markov Chains

Maintenance policy for a system with a weighted linear combination of degradation processes

Imperfect and worse than old maintenances for a gamma degradation process

Age-replacement Policy for Items Described by Stochastic Degradation with Dependent Increments

On a new age-replacement policy for items with observed stochastic degradation

An $(\underline{s},\overline{s},S)$ optimal maintenance policy for systems subject to shocks and progressive deterioration

A Framework for Modeling and Optimizing Maintenance in Systems Considering Epistemic Uncertainty and Degradation Dependence Based on PDMPs.

A condition-based maintenance policy for a two-component balanced system with dependent degradation processes

Condition-based maintenance assessment for a deteriorating system considering stochastic failure dependence

Optimum maintenance policy with Markov processes

Maintenance Policies for Two-Unit Balanced Systems Subject to Degradation

Replacement Policy for Heterogeneous Items Subject to Gamma Degradation Processes

Quality driven maintenance policies for a deteriorating system subject to non-self-announcing failures

A Dynamic Maintenance Policy for Degradation System by State Monitoring and Deep Reinforcement Learning

Condition-based maintenance policy for systems under dynamic environment

Optimal Replacement Policy for Multi-State System Under Imperfect Maintenance

Condition-Based Maintenance Policy for Systems with a Non-Homogeneous Degradation Process.

Condition-based maintenance for a system subject to multiple degradation processes with stochastic arrival intensity

Imperfect preventive maintenance policy of deteriorating systems based on failure limit