Abstract:Selective maintenance, which aims to choose a subset of feasible maintenance actions to be performed for a repairable system with limited maintenance resources, has been extensively studied over the past decade. Most of the reported works on selective maintenance have been dedicated to maximizing the success of a single future mission. Cases of multiple consecutive missions, which are oftentimes encountered in engineering practices, have been rarely investigated to date. In this paper, a new selective maintenance optimization for multi-state systems that can execute multiple consecutive missions over a finite horizon is developed. The selective maintenance strategy can be dynamically optimized to maximize the expected number of future mission successes whenever the states and effective ages of the components become known at the end of the last mission. The dynamic optimization problem, which accounts for imperfect maintenance, is formulated as a discrete-time finite-horizon Markov decision process with a mixed integer-discrete-continuous state space. Based on the framework of actor-critic algorithms, a customized deep reinforcement learning method is put forth to overcome the "curse of dimensionality" and mitigate the uncountable state space. In our proposed method, a postprocess is developed for the actor to search the optimal maintenance actions in a large-scale discrete action space, whereas the techniques of the experience replay and the target network are utilized to facilitate the agent training. The performance of the proposed method is examined by an illustrative example and an engineering example of a coal transportation system. (C) 2019 Elsevier B.V. All rights reserved.

Condition-Based Preventive Maintenance Optimization Approach for Multiple Industrial Robotics with Stochastic Mission

Precision Sensitivity Optimization for Parallel Robotic System Based on Multi-Source Preventive Maintenance

Optimal Selective Maintenance Decision-Making for Consecutive-Mission Systems with Variable Durations and Limited Maintenance Time

Selective Maintenance Optimization for a Multi-State System Considering Human Reliability

Stochastic programming for selective maintenance optimization with uncertainty in the next mission conditions

Selective Maintenance Strategy for Systems Executing Multiple Consecutive Missions with Uncertainty.

System-Level Predictive Maintenance Optimization for No-Wait Production Machine–Robot Collaborative Environment under Economic Dependency and Hybrid Fault Mode

Selective Maintenance Optimization under Limited Maintenance Capacities: A Machine Learning-Enhanced Approximate Dynamic Programming

Selective Maintenance for Systems Operating Multiple Consecutive Missions

Integrated Selective Maintenance and Task Assignment Optimization for Multi-State Systems Executing Multiple Missions

Selective Maintenance Optimisation Considering Random Common Cause Failures and Imperfect Maintenance

Condition-based Maintenance Optimization for Multi-Equipment Batch Production System Based on Stochastic Demand

Joint Optimization of Fleet-Level Sequential Selective Maintenance and Repairpersons Assignment for Multi-State Manufacturing Systems

Dynamic Selective Maintenance for Multi-state Systems Operating Multiple Consecutive Missions

Selective Maintenance under Stochastic Time Durations of Breaks and Maintenance Actions

Preventive Maintenance Optimization for a Multi-Component System under Changing Job Shop Schedule.

Selective Maintenance Optimization under Uncertainty: Stochastic Programming Approach

An integrated framework of preventive maintenance and task scheduling for repairable multi-unit systems

Optimal Policy Study on Reliability-Centered Preventive Maintenance for a Single-Equipment System

Multi-objective maintenance strategy for complex systems considering the maintenance uncertain impact by adaptive multi-strategy particle swarm optimization

Dynamic Selective Maintenance Optimization for Multi-State Systems over a Finite Horizon: A Deep Reinforcement Learning Approach.