Abstract:This paper studies how to model and resolve the dynamic maintenance problem for the continuous degrading system. The main objective is to realize the maintenance cost optimization and determine the optimal maintenance action in the real-time degradation system. First, a deterioration model based on the Wiener process with Brownian motion is described to simulate the deterioration system and estimate the deterioration level. Second, a data-processing method is applied to discretize the continuous degradation into the discrete degradation state. Thus, a discrete-time finite Markov decision process (MDP) model is established to describe the maintenance decision processes. Third, a dynamic maintenance decision framework is constructed by periodic status monitoring and a customized deep reinforcement learning method. The developed decision framework determines the maintenance action by utilizing the specific degradation state at each inspection stage. Fourth, a maintenance decision agent is developed by employing a customized proximal policy optimization with an entropy regularization approach to solve the dynamic maintenance problem, in which the deep actor- critic networks, advantage function estimation method, truncated surrogate approach, and entropy regularization approach are integrated to facilitate the policy optimization processes, and the customized maintenance decision approach is also verified by simulation analysis. To illustrate the effectiveness, comparison studies are conducted and the results demonstrate that: (i) the cumulative maintenance costs are decreased and approaching the approximated equilibrium state by running the proposed maintenance decision algorithm; (ii) the proposed customized deep reinforcement learning approach for the maintenance decision problem can be implemented easily, and the efficiency and stability can be enhanced distinctively; (iii) the proposed maintenance framework can provide a useful decision tool for engineering manager.

Maintenance optimisation of multi-unit balanced systems using deep reinforcement learning

An Optimum Condition-Based Replacement And Spare Provisioning Policy Based On Markov Chains

Maintenance modeling for balanced systems subject to two competing failure modes

Imperfect Maintenance Optimization of Multi-State Rolling Stocks Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Dynamic Opportunistic Maintenance of Multi-Component Systems With Load Sharing

A Dynamic Maintenance Policy for Degradation System by State Monitoring and Deep Reinforcement Learning

Optimal condition-based preventive maintenance policy for balanced systems

A condition-based maintenance policy for a two-component balanced system with dependent degradation processes

Deep Reinforcement Learning for Maintenance Optimization of Multi-Component Production Systems Considering Quality and Production Plan

Maintenance Policies for Two-Unit Balanced Systems Subject to Degradation

Optimal preventive maintenance policy of the balanced system under the semi-Markov model

A deep reinforcement learning-driven multi-objective optimization and its applications on aero-engine maintenance strategy

Optimal Condition-based Opportunistic Maintenance and Spare Parts Provisioning for a Two-unit System using a State Space Partitioning Approach

Optimal maintenance strategy for multi-state systems with single maintenance capacity and arbitrarily distributed maintenance time

Deep learning-based intelligent multilevel predictive maintenance framework considering comprehensive cost

Joint optimization of maintenance and quality inspection for manufacturing networks based on deep reinforcement learning

Real-Time Integrated Learning and Decision-Making for Asset Networks

Joint optimization of preventive maintenance and production scheduling for multi-state production systems based on reinforcement learning

A Prognosis-Centered Intelligent Maintenance Optimization Framework Under Uncertain Failure Threshold

An imperfect age-based and condition-based opportunistic maintenance model for a two-unit series system

Multi-agent deep reinforcement learning based Predictive Maintenance on parallel machines