Abstract:Problem definition: Unexpected component failures in industrial assets can lead to significant financial losses and operational disruptions, making preventive maintenance crucial for reducing unplanned downtime. This study focuses on optimizing maintenance for economically coupled assets that degrade according to a compound Poisson process, failing when degradation exceeds a specified threshold. Degradation parameters vary across components and cannot be directly observed, necessitating inference from real-time sensor data, with maintenance limited to scheduled interventions. Academic/practical relevance: We characterize optimal replacement policies that have access to the degradation process parameters, which inform suitable initial policies for our deep reinforcement learning (DRL) algorithm. The effectiveness of the trained policies is demonstrated through a case study on interventional X-ray systems. Methodology: The maintenance optimization problem is modeled as a partially observable Markov decision process (POMDP). To manage the inherent computational complexity, we reformulate it as a Bayesian Markov decision process (BMDP) using conjugate pairs. This allows us to extend the DRL algorithm to BMDPs. Additionally, we propose an open-loop feedback approach to adapt the DRL algorithm to the POMDP setting when a BMDP reformulation is infeasible. Results: Numerical results indicate that our DRL algorithm effectively reduces maintenance costs and unplanned downtime by leveraging real-time data and shared setup costs to learn state-of-the-art complex opportunistic maintenance policies. Managerial implications: Our approach demonstrates how integrating real-time learning and decision-making can significantly lower costs in industrial asset networks, providing a practical solution for improving operational efficiency amidst asset heterogeneity and economic dependence.

A Deep Reinforcement Learning Approach to Asset-Liability Management

Bridging the gap between Markowitz planning and deep reinforcement learning

Deep Reinforcement Learning for Asset Allocation in US Equities

Deep treasury management for banks

A case study for unlocking the potential of deep learning in asset-liability-management

Real-Time Integrated Learning and Decision-Making for Asset Networks

Asset Allocation: From Markowitz to Deep Reinforcement Learning

Continuous-Action Reinforcement Learning for Portfolio Allocation of a Life Insurance Company

Deep Reinforcement Learning Strategies in Finance: Insights into Asset Holding, Trading Behavior, and Purchase Diversity

A General Framework on Enhancing Portfolio Management with Reinforcement Learning

Tradeoffs When Considering Deep Reinforcement Learning for Contingency Management in Advanced Air Mobility

Model-Free Reinforcement Learning for Asset Allocation

A Deep Reinforcement Learning Framework For Financial Portfolio Management

Model-based Deep Reinforcement Learning for Dynamic Portfolio Optimization

Advancing Investment Frontiers: Industry-grade Deep Reinforcement Learning for Portfolio Optimization

Enhancing Adaptive Mixed-Criticality Scheduling with Deep Reinforcement Learning

Deep reinforcement learning driven inspection and maintenance planning under incomplete information and constraints

Reinforcement-Learning based Portfolio Management with Augmented Asset Movement Prediction States

Deep Replication of a Runoff Portfolio

Towards a Standardized Reinforcement Learning Framework for AAM Contingency Management

Model-based Reinforcement Learning for Semi-Markov Decision Processes with Neural ODEs