Abstract:Problem definition: Unexpected component failures in industrial assets can lead to significant financial losses and operational disruptions, making preventive maintenance crucial for reducing unplanned downtime. This study focuses on optimizing maintenance for economically coupled assets that degrade according to a compound Poisson process, failing when degradation exceeds a specified threshold. Degradation parameters vary across components and cannot be directly observed, necessitating inference from real-time sensor data, with maintenance limited to scheduled interventions. Academic/practical relevance: We characterize optimal replacement policies that have access to the degradation process parameters, which inform suitable initial policies for our deep reinforcement learning (DRL) algorithm. The effectiveness of the trained policies is demonstrated through a case study on interventional X-ray systems. Methodology: The maintenance optimization problem is modeled as a partially observable Markov decision process (POMDP). To manage the inherent computational complexity, we reformulate it as a Bayesian Markov decision process (BMDP) using conjugate pairs. This allows us to extend the DRL algorithm to BMDPs. Additionally, we propose an open-loop feedback approach to adapt the DRL algorithm to the POMDP setting when a BMDP reformulation is infeasible. Results: Numerical results indicate that our DRL algorithm effectively reduces maintenance costs and unplanned downtime by leveraging real-time data and shared setup costs to learn state-of-the-art complex opportunistic maintenance policies. Managerial implications: Our approach demonstrates how integrating real-time learning and decision-making can significantly lower costs in industrial asset networks, providing a practical solution for improving operational efficiency amidst asset heterogeneity and economic dependence.

Optimal data pooling for shared learning in maintenance operations

An Optimum Condition-Based Replacement And Spare Provisioning Policy Based On Markov Chains

Managing Inventory for a Multidivisional Firm with Cash Pooling.

Joint condition-based maintenance and load-sharing optimization for two-unit systems with economic dependency

Optimal Condition-based Opportunistic Maintenance and Spare Parts Provisioning for a Two-unit System using a State Space Partitioning Approach

Deep Reinforcement Learning for Dynamic Opportunistic Maintenance of Multi-Component Systems With Load Sharing

Maintaining Partially Observed Systems with Imperfect Observation and Resource Constraint.

Maintenance Optimization of Multi-Unit Balanced Systems Using Deep Reinforcement Learning

Maintenance optimisation of multi-unit balanced systems using deep reinforcement learning

Condition-Based Production for Stochastically Deteriorating Systems: Optimal Policies and Learning

Modified Iterative Aggregation Procedure for Maintenance Optimisation of Multi-Component Systems with Failure Interaction

Real-Time Integrated Learning and Decision-Making for Asset Networks

Deterioration state space partitioning method for opportunistic maintenance modelling of identical multi-unit systems

Decentralized Maintenance for Multistate Systems with Heterogeneous Components

Bridging POMDPs and Bayesian decision making for robust maintenance planning under model uncertainty: An application to railway systems

A condition-based maintenance policy for a two-component balanced system with dependent degradation processes

Generalized Condition-Based Maintenance Optimization for Multi-Component Systems Considering Stochastic Dependency and Imperfect Maintenance.

A Pomdp Based Decentralized Maintenance for Multi-State System with Heterogeneous Components

Optimal maintenance strategy for multi-state systems with single maintenance capacity and arbitrarily distributed maintenance time

Optimal Maintenance Policy for Multi-Component Systems under Markovian Environment Changes.

Selective Maintenance Optimization under Limited Maintenance Capacities: A Machine Learning-Enhanced Approximate Dynamic Programming