Abstract:This paper studies how to model and resolve the dynamic maintenance problem for the continuous degrading system. The main objective is to realize the maintenance cost optimization and determine the optimal maintenance action in the real-time degradation system. First, a deterioration model based on the Wiener process with Brownian motion is described to simulate the deterioration system and estimate the deterioration level. Second, a data-processing method is applied to discretize the continuous degradation into the discrete degradation state. Thus, a discrete-time finite Markov decision process (MDP) model is established to describe the maintenance decision processes. Third, a dynamic maintenance decision framework is constructed by periodic status monitoring and a customized deep reinforcement learning method. The developed decision framework determines the maintenance action by utilizing the specific degradation state at each inspection stage. Fourth, a maintenance decision agent is developed by employing a customized proximal policy optimization with an entropy regularization approach to solve the dynamic maintenance problem, in which the deep actor- critic networks, advantage function estimation method, truncated surrogate approach, and entropy regularization approach are integrated to facilitate the policy optimization processes, and the customized maintenance decision approach is also verified by simulation analysis. To illustrate the effectiveness, comparison studies are conducted and the results demonstrate that: (i) the cumulative maintenance costs are decreased and approaching the approximated equilibrium state by running the proposed maintenance decision algorithm; (ii) the proposed customized deep reinforcement learning approach for the maintenance decision problem can be implemented easily, and the efficiency and stability can be enhanced distinctively; (iii) the proposed maintenance framework can provide a useful decision tool for engineering manager.

Risk-based adaptive maintenance modeling of stochastically deteriorating systems

Condition-based maintenance for a system subject to multiple degradation processes with stochastic arrival intensity

Maintenance policy for a system with a weighted linear combination of degradation processes

Condition-based maintenance assessment for a deteriorating system considering stochastic failure dependence

A Stochastic Model on One-Unit Repairable Systems with Multiple Degenerative States.

An adaptive reliability-based maintenance policy for mechanical systems under variable environments

A Framework for Modeling and Optimizing Maintenance in Systems Considering Epistemic Uncertainty and Degradation Dependence Based on PDMPs.

Stochastic comparisons of imperfect maintenance models for a gamma deteriorating system

Modeling of condition-based maintenance and spare parts provisioning policy for single-unit system with two-stage degradation

How Heterogeneity Influences Condition-Based Maintenance for Gamma Degradation Process

Optimization of preventive maintenance for a multi-state degraded system by monitoring component performance

A maintenance policy for a deteriorating system under epistemic uncertainty

Component Rearrangement and System Replacement for a System with Stochastic Degradation Processes

A condition-based maintenance policy for a two-component balanced system with dependent degradation processes

Condition-based maintenance policy for systems under dynamic environment

Stochastic Multi-phase Modeling and Health Assessment for Systems Based on Degradation Branching Processes

Maintenance optimisation for systems with multi-dimensional degradation and imperfect inspections

A Dynamic Maintenance Policy for Degradation System by State Monitoring and Deep Reinforcement Learning

An Improved Non-Markovian Degradation Model with Long-Term Dependency and Item-to-item Uncertainty

Bayesian Degradation Analysis With Inverse Gaussian Process Models Under Time-Varying Degradation Rates

Imperfect and worse than old maintenances for a gamma degradation process