A Multi-state Markov Model to Infer the Latent Deterioration Process From the Maintenance Effect on Reliability Engineering of Ships

Hyunji Moon,Jungin Choi,Seoyeon Cha

DOI: https://doi.org/10.48550/arXiv.2111.14368

2022-03-10

Abstract:Maintenance optimization of naval ship equipment is crucial in terms of national defense. However, the mixed effect of the maintenance and the pure deterioration processes in the observed data hinders an exact comparison between candidate maintenance policies. That is, the observed data-annual failure counts of naval ships reflect counteracting actions between the maintenance and deterioration. The inference of the latent deteriorating process is needed in advance for choosing an optimal maintenance policy to be carried out. This study proposes a new framework for the separation of the true deterioration effect by predicting it from the current maintenance effect through the multi-state Markov model. Using an annual engine failure count of 99 ships in the Korean navy, we construct the framework consisting of imputation, transition matrix design, optimization, and validation. The hierarchical Gaussian process model is used for the imputation and the three-state Markov model is applied for the estimation of parameters in the deterioration and maintenance effect. To consider the natural (deterioration) and artificial (maintenance) effect respectively, the Bayesian HMM model with a categorical distribution is employed. Computational experiments under multiple settings showed the robustness of the estimated parameters, as well as an accurate recovery of the observed data, thereby confirming the credibility of our model. The framework could further be employed to establish a reliable maintenance system and to reduce an overall maintenance cost.

Applications

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to infer the hidden deterioration process under the influence of the current maintenance policy in the maintenance of naval ship equipment. Specifically, the paper points out that the annual number of failures data reflects the combined effect of the maintenance and deterioration processes, which makes it difficult to compare different maintenance strategies. Therefore, it is necessary to first infer the hidden deterioration process in order to select the optimal maintenance strategy. To this end, the research proposes a new framework to predict the real deterioration process from the current maintenance effect through the multi - state Markov model. The key points of the paper are as follows: 1. **Problem background**: The maintenance optimization of naval ship equipment is crucial for national security, but the observed data (such as the annual number of failures) contains the mixed effects of maintenance and deterioration, which hinders the accurate comparison of candidate maintenance strategies. 2. **Research objective**: Propose a new framework for separating the real deterioration process, thereby providing a basis for selecting the optimal maintenance strategy. 3. **Method**: Use the multi - state Markov model, combined with the Gaussian process model for data imputation, design the transition matrix, and estimate the parameters through optimization and verification. 4. **Application**: Using the ten - year engine failure data of 99 South Korean naval ships, a framework including data imputation, transition matrix design, optimization and verification is constructed. Through this method, the research aims to support the establishment of a reliable maintenance system and reduce the overall maintenance cost.

A Multi-state Markov Model to Infer the Latent Deterioration Process From the Maintenance Effect on Reliability Engineering of Ships

An Optimum Condition-Based Replacement And Spare Provisioning Policy Based On Markov Chains

Maintenance management of offshore structures using Markov process model with random transition probabilities

Optimum Life-Cycle Maintenance Strategies of Deteriorating Highway Bridges Subject to Seismic Hazard by a Hybrid Markov Decision Process Model

Combining Similarity Measures and Left-Right Hidden Markov Models for Prognostics of Items Subjected to Perfect and Imperfect Maintenance

SHM-informed life-cycle intelligent maintenance of fatigue-sensitive detail using Bayesian forecasting and Markov decision process

Markovian Maintenance Planning of Ship Propulsion System Accounting for CII and System Degradation

Hyper-parameter Optimization Based Nonlinear Multistate Deterioration Modeling for Deterioration Level Assessment and Remaining Useful Life Prognostics.

Predictive Analytics Using A Nonhomogeneous Semi-Markov Model And Inspection Data

System reliability modeling and analysis for a marine power equipment operating in a discrete‐time dynamic environment

Piecewise deterministic Markov process for condition-based imperfect maintenance models

A State-Space-Based Prognostic Model for Hidden and Age-Dependent Nonlinear Degradation Process

A Multi-Stage Imperfect Maintenance Strategy for Multi-State Systems with Variable User Demands

Hidden Markov Model with Auto-Correlated Observations for Remaining Useful Life Prediction and Optimal Maintenance Policy.

A Dynamic Maintenance Policy for Degradation System by State Monitoring and Deep Reinforcement Learning

Optimization of preventive maintenance for a multi-state degraded system by monitoring component performance

A dynamic predictive maintenance model considering spare parts inventory based on hidden semi-Markov model

Anomaly detection and confidence interval‐based replacement in decay state coefficient of ship power system

Modeling for reliability optimization of system design and maintenance based on Markov chain theory

Health Status-Based Predictive Maintenance Decision-Making via LSTM and Markov Decision Process

An MEWMA-based Segmental Multivariate Hidden Markov Model for Degradation Assessment and Prediction