Abstract:The industrial fault prediction based on time series data inference is a very meaningful work. Generally, this task has two key difficulties including the limited amount of fault data and learning of timeline-based knowledge. In this paper, we propose a novel dual enhancement method to conduct the time series fault prediction task. It consists of a time series sample augmentation (TSSA) strategy and a timing integration attention enhancement model, named time series enhanced transformer (TSET). Specifically, we decompose the original signal by variational mode decomposition and then add the noise signal for recombination, so as to augment the time series samples. Furthermore, to solve the problem that the traditional transformer is difficult to adequately extract the features from time series data, we propose a new timing association attention module to enhance the time series feature learning. It obtains the comprehensive temporal related features formed by a time integration function and then inputs them to the different channels of the attention mechanism in the transformer architecture. A TSET is constructed by the dual enhancement. We validate the proposed method on both public and industrial datasets. The experimental results show that our method can outperform the mainstream baseline methods. Note to practitioners—The model in this paper is applied to fault prediction in industrial automation processes. The log and fault record data generated in industrial processes are natural time series data. Time series prediction models generated in the field of Natural language processing need a lot of corpus data to generate reasonable inference results. However, the fault data of industrial processes usually cannot reach an order of magnitude sufficient for these models to operate well. On the other hand, these corpus based data models are not friendly to industrial fault data. The model in this paper is established from two aspects: data enhancement and temporal correlation enhancement, so that the industrial fault sample data can meet the needs of the prediction model as much as possible. By enhancing temporal correlation features, the prediction model becomes friendly to industrial temporal fault data. The method is validated through experiments on actual industrial process data and public datasets. In practical applications, inputting data into the model proposed in the paper generates prediction results based on time series, and distinguishes whether the predicted data is a fault, thereby providing fault warning, which is helpful for the automation of the entire industrial life cycle.

Predict Industrial Equipment Failure with Time Windows and Transfer Learning

Predicting machine failures from multivariate time series: an industrial case study

Time Series Prediction Method of Industrial Process With Limited Data Based on Transfer Learning

Pre-training enhanced unsupervised contrastive domain adaptation for industrial equipment remaining useful life prediction

Adaptive soft sensor based on time difference model and locally weighted partial least squares regression

Time Series Fault Prediction Via Dual Enhancement

Multi-task spatio-temporal augmented net for industry equipment remaining useful life prediction

Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning

Time-varying Online Transfer Learning for Intelligent Bearing Fault Diagnosis with Incomplete Unlabeled Target Data

Deep Transfer Learning Based on Sparse Autoencoder for Remaining Useful Life Prediction of Tool in Manufacturing

A Remaining Useful Life Prediction Framework Integrating Multiple Time Window Convolutional Neural Networks

Machine learning-based failure prediction in industrial maintenance: improving performance by sliding window selection

Design of Fault Prediction System for Electromechanical Sensor Equipment Based on Deep Learning

Combining adaptive time-series feature window and stacked bidirectional LSTM for predicting tool remaining useful life without failure data

Remaining Useful Life Prediction: A Study on Multidimensional Industrial Signal Processing and Efficient Transfer Learning Based on Large Language Models

Micro Transfer Learning Mechanism for Cross-Domain Equipment RUL Prediction

A Novel Deep Learning Approach For Machinery Prognostics Based On Time Windows

Fault Knowledge Transfer Assisted Ensemble Method for Remaining Useful Life Prediction

A novel approach based on spatio-temporal attention and multi-scale modeling for mechanical failure prediction

A Probabilistic Machine Learning Approach to Detect Industrial Plant Faults