Abstract:This paper studies how to model and resolve the dynamic maintenance problem for the continuous degrading system. The main objective is to realize the maintenance cost optimization and determine the optimal maintenance action in the real-time degradation system. First, a deterioration model based on the Wiener process with Brownian motion is described to simulate the deterioration system and estimate the deterioration level. Second, a data-processing method is applied to discretize the continuous degradation into the discrete degradation state. Thus, a discrete-time finite Markov decision process (MDP) model is established to describe the maintenance decision processes. Third, a dynamic maintenance decision framework is constructed by periodic status monitoring and a customized deep reinforcement learning method. The developed decision framework determines the maintenance action by utilizing the specific degradation state at each inspection stage. Fourth, a maintenance decision agent is developed by employing a customized proximal policy optimization with an entropy regularization approach to solve the dynamic maintenance problem, in which the deep actor- critic networks, advantage function estimation method, truncated surrogate approach, and entropy regularization approach are integrated to facilitate the policy optimization processes, and the customized maintenance decision approach is also verified by simulation analysis. To illustrate the effectiveness, comparison studies are conducted and the results demonstrate that: (i) the cumulative maintenance costs are decreased and approaching the approximated equilibrium state by running the proposed maintenance decision algorithm; (ii) the proposed customized deep reinforcement learning approach for the maintenance decision problem can be implemented easily, and the efficiency and stability can be enhanced distinctively; (iii) the proposed maintenance framework can provide a useful decision tool for engineering manager.

On Equilibrium Performance Assurance with Costly Monitoring.

A novel single-principal-multiple-agent repeated game model and solution method for performance assurance of emergency supplies

An Optimum Condition-Based Replacement And Spare Provisioning Policy Based On Markov Chains

Monitoring Strategies of Enterprise's Emission Reduction with Asymmetric Information.

Dynamic Contract Design in the Presence Of Double Moral Hazard

Optimal incentive contract with endogenous monitoring technology

RELIABILITY AND CHECK REPLACEMENT POLICY OF MECHANICAL EQUIPMENT UNDER PREDICTIVE MAINTENANCE

Failure risk management: adaptive performance control and mission abort decisions

But Who Will Monitor the Monitor?

A Dynamic Maintenance Policy for Degradation System by State Monitoring and Deep Reinforcement Learning

Efficient Policy Evaluation with Safety Constraint for Reinforcement Learning

After-Sales Service Contracting: Condition Monitoring and Data Ownership

Monitoring with Rich Data

Tripartite Evolutionary Game and Simulation Analysis of Healthcare Fraud Supervision under the Government Reward and Punishment Mechanism

Policy Certificates: Towards Accountable Reinforcement Learning

Peer effect and dynamic ALM games among insurers

Estimating and Incentivizing Imperfect-Knowledge Agents with Hidden Rewards

Progressive Adaptive Chance-Constrained Safeguards for Reinforcement Learning.

Designing monitoring strategies for deployed machine learning algorithms: navigating performativity through a causal lens

Probabilistic Automata-Based Method for Enhancing Performance of Deep Reinforcement Learning Systems

A Dynamic Opportunistic Maintenance Policy For Continuously Monitored Systems