Abstract:Often in manufacturing systems, scenarios arise where the demand for maintenance exceeds the capacity of maintenance resources. This results in the problem of allocating the limited resources among machines competing for them. This maintenance scheduling problem can be formulated as a Markov decision process (MDP) with the goal of finding the optimal dynamic maintenance action given the current system state. However, as the system becomes more complex, solving an MDP suffers from the curse of dimensionality. To overcome this issue, we propose a two-stage approach that first optimizes a static condition-based maintenance (CBM) policy using a genetic algorithm (GA) and then improves the policy online via Monte Carlo tree search (MCTS). The static policy significantly reduces the state space of the online problem by allowing us to ignore machines that are not sufficiently degraded. Furthermore, we formulate MCTS to seek a maintenance schedule that maximizes the long-term production volume of the system to reconcile the conflict between maintenance and production objectives. We demonstrate that the resulting online policy is an improvement over the static CBM policy found by GA. Note to practitioners—: This article proposes a method of scheduling maintenance in complex manufacturing systems in scenarios where there is frequent competition for maintenance resources. We use a condition-based maintenance policy that prescribes maintenance actions based on a machine's current health. However, when several machines are due for maintenance, a maintenance technician must choose between multiple competing jobs. While a common approach is to establish rules that dictate how maintenance jobs should be prioritized, such as the first-in, first-out rule, the goal of this work is to improve upon static policies in real time. We do this by strategically evaluating sequences of maintenance actions and playing out many "what-if" scenarios to see how the system will behave in the future. Implementation of the proposed method relies on the construction of a simulation model of the target system. This model is capable of retrieving the current state of the physical system, including the degradation state of machines, the availability of maintenance resources, and the distribution of parts throughout buffers in the system. We present several simulation experiments that demonstrate the improvement in system performance that our approach provides. Future work will aim to improve the efficiency of maintenance prioritization through online learning as well as more accurately identify manufacturing system configurations that will yield the greatest benefit of these methods.

Optimal Cbpm Policy Considering Maintenance Effects and Environmental Condition

A Condition-Based Maintenance Policy for Multi-Component Systems Subject to Stochastic and Economic Dependencies

Reliability-centered predictive maintenance scheduling for a continuously monitored system subject to degradation

Quality and Reliability Oriented Maintenance for Multistage Manufacturing Systems Subject to Condition Monitoring

Condition‐based maintenance policy for a multi‐component system considering stochastic dependence and quality loss

Condition-based Maintenance with Imperfect Inspections for Continuous Degradation Processes

Condition-based Maintenance for a Multi-Component System in a Dynamic Operating Environment

A Condition-Based Maintenance Policy for Intelligent Monitored System

Research on maintenance type selection with CBM technology based on effectiveness and cost analysis

Joint Optimization of Condition-Based Operation and Maintenance for Continuous Process Manufacturing Systems under Imperfect Maintenance

Optimum Maintenance Policy for Power Delivery Equipment Based on Markov Decision Process

A Prognosis-Centered Intelligent Maintenance Optimization Framework Under Uncertain Failure Threshold

Generalized Condition-Based Maintenance Optimization for Multi-Component Systems Considering Stochastic Dependency and Imperfect Maintenance.

Optimal Condition-Based Maintenance Policy for Multi-Component Repairable Systems with Economic Dependence in a Finite-Horizon

Joint Optimal Production Planning and Proactive Maintenance Policy for a System Subject to Degradation

Optimization of Condition‐based Maintenance Considering Partial Opportunities

Condition-Based Maintenance Optimization Method Using Performance Margin.

Online Improvement of Condition-Baesd Maintenance Policy via Monte Carlo Tree Search

Optimal condition-based preventive maintenance policy for balanced systems

Condition-based maintenance policy for systems under dynamic environment

Condition-Based Maintenance for Intelligent Monitored Series System with Independent Machine Failure Modes