Abstract:In contemporary industrial systems, the prediction of remaining useful life (RUL) is recognized as a valuable maintenance strategy for health management due to its ability to monitor equipment operational status in real time and ensure the safety of industrial production. Current studies have largely concentrated on deep learning (DL) techniques, leading to a shortage of RUL prediction methods that utilize deep reinforcement learning (DRL). To further enhance application and research, this paper introduces a novel approach to RUL prediction based on DRL, specifically using a combination of Convolutional Neural Network-Bidirectional Long Short-Term Memory Network (CNN-BiLSTM) and the Deep Deterministic Policy Gradient (DDPG) algorithm. The proposed method reframes the conventional task of estimating RUL as a Markov decision process (MDP), effectively integrating the feature extraction capabilities of DL with the decision-making abilities of DRL. Initially, a hybrid CNN-BiLSTM is employed to establish an agent that can extract degradation features from raw signals. Subsequently, the DDPG algorithm within DRL is leveraged to develop the RUL prediction mechanism, completing the MDP by defining appropriate action spaces and reward functions. The agent, through repeated trials and optimization, learns to map the current operational state of the rolling bearing to its remaining service life. Validation analysis was performed on the intelligent maintenance systems (IMS) bearing dataset. The findings suggest that the DRL-based approach outperforms the current methodologies, demonstrating a superior performance in root mean square error (MSE) and MSE metrics. The predicted outcomes align more closely with the actual lifespan values.

Dynamic Bayesian networks for predicting remaining useful life of equipment

Dynamic Bayesian Networks for Feature Learning and Transfer Applications in Remaining Useful Life Estimation

A Bayesian Mixture Neural Network for Remaining Useful Life Prediction of Lithium-Ion Batteries

A Novel Deep Belief Network Model Constructed by Improved Conditional RBMs and its Application in RUL Prediction for Hydraulic Pumps

Dynamic Bayesian Network for Robust Latent Variable Modeling and Fault Classification

Remaining useful life prediction of rolling bearings based on Bayesian neural network and uncertainty quantification

Bayesian deep-learning for RUL prediction: An active learning perspective

Deep Bidirectional Recurrent Neural Networks Ensemble for Remaining Useful Life Prediction of Aircraft Engine

A Multimodal Dynamic Parameterized Bilinear Factorized Framework for Remaining Useful Life Prediction under Variational Data

A prognostic model for multi-stage degraded equipment under zero life label combining CDBN and Bayesian bidirectional GRU

Joint modeling of degradation signals and time‐to‐event data for the prediction of remaining useful life

A robust health prediction using Bayesian approach guided by physical constraints

Multi-Sensor Data Fusion for Remaining Useful Life Prediction of Machining Tools by IABC-BPNN in Dry Milling Operations

A Hybrid Model-based Prognostics Approach for Estimating Remaining Useful Life of Rolling Bearings

Remaining useful life prediction for bivariate deteriorating systems under dynamic operational conditions

Method for remaining useful life prediction of rolling bearings based on deep reinforcement learning

Dynamic Bayesian Network-Based Lithium-Ion Battery Health Prognosis for Electric Vehicles

A Bayesian Deep Learning Framework for RUL Prediction Incorporating Uncertainty Quantification and Calibration

Relational Dynamic Bayesian Networks

A deep learning-based two-stage prognostic approach for remaining useful life of rolling bearing