Abstract:The industrial fault prediction based on time series data inference is a very meaningful work. Generally, this task has two key difficulties including the limited amount of fault data and learning of timeline-based knowledge. In this paper, we propose a novel dual enhancement method to conduct the time series fault prediction task. It consists of a time series sample augmentation (TSSA) strategy and a timing integration attention enhancement model, named time series enhanced transformer (TSET). Specifically, we decompose the original signal by variational mode decomposition and then add the noise signal for recombination, so as to augment the time series samples. Furthermore, to solve the problem that the traditional transformer is difficult to adequately extract the features from time series data, we propose a new timing association attention module to enhance the time series feature learning. It obtains the comprehensive temporal related features formed by a time integration function and then inputs them to the different channels of the attention mechanism in the transformer architecture. A TSET is constructed by the dual enhancement. We validate the proposed method on both public and industrial datasets. The experimental results show that our method can outperform the mainstream baseline methods. Note to practitioners—The model in this paper is applied to fault prediction in industrial automation processes. The log and fault record data generated in industrial processes are natural time series data. Time series prediction models generated in the field of Natural language processing need a lot of corpus data to generate reasonable inference results. However, the fault data of industrial processes usually cannot reach an order of magnitude sufficient for these models to operate well. On the other hand, these corpus based data models are not friendly to industrial fault data. The model in this paper is established from two aspects: data enhancement and temporal correlation enhancement, so that the industrial fault sample data can meet the needs of the prediction model as much as possible. By enhancing temporal correlation features, the prediction model becomes friendly to industrial temporal fault data. The method is validated through experiments on actual industrial process data and public datasets. In practical applications, inputting data into the model proposed in the paper generates prediction results based on time series, and distinguishes whether the predicted data is a fault, thereby providing fault warning, which is helpful for the automation of the entire industrial life cycle.

Fault prediction method via time series predictive neural nets and its application

Fault Prediction for Distribution Network Based on CNN and LightGBM Algorithm

Application of Neural Networks to Chemical Fault Diagnosis

Application Of Grey Theory To Fault Prediction Of Chemical Equipment System

Time Series Fault Prediction Via Dual Enhancement

Deep Learning With Tensor Factorization Layers For Sequential Fault Diagnosis And Industrial Process Monitoring

Fault prediction approach for dynamic system

Data-Based Line Trip Fault Prediction in Power Systems Using LSTM Networks and SVM.

Fault Prediction for Electromechanical Equipment Based on Spatial-Temporal Graph Information

A Data-Driven Long Time-Series Electrical Line Trip Fault Prediction Method Using an Improved Stacked-Informer Network

A Novel Sequence Discriminative Feature Extraction Network and Its Application in Offline Industrial Fault Pattern Clustering

Deep Learning Neural Network For Power System Fault Diagnosis

Fault prediction method for nuclear power machinery based on Bayesian PPCA recurrent neural network model

A Novel Fault Diagnosis Approach Based on Correlation Analysis and Improved Two-Stream Neural Networks

Early fault prediction for wind turbines based on deep learning

Approach for Fault Prognosis Using Recurrent Neural Network

Fault Prediction for State-Dependent Fault Based on Online Learning Neural Network

Advancing Fault Prediction: A Comparative Study between LSTM and Spiking Neural Networks

Fault Prediction of Electromagnetic Launch System Based on Knowledge Prediction Time Series

A novel fault diagnosis method based on CNN and LSTM and its application in fault diagnosis for complex systems

An adaptive strategy for time‐varying batch process fault prediction based on stochastic configuration network