Abstract:The industrial fault prediction based on time series data inference is a very meaningful work. Generally, this task has two key difficulties including the limited amount of fault data and learning of timeline-based knowledge. In this paper, we propose a novel dual enhancement method to conduct the time series fault prediction task. It consists of a time series sample augmentation (TSSA) strategy and a timing integration attention enhancement model, named time series enhanced transformer (TSET). Specifically, we decompose the original signal by variational mode decomposition and then add the noise signal for recombination, so as to augment the time series samples. Furthermore, to solve the problem that the traditional transformer is difficult to adequately extract the features from time series data, we propose a new timing association attention module to enhance the time series feature learning. It obtains the comprehensive temporal related features formed by a time integration function and then inputs them to the different channels of the attention mechanism in the transformer architecture. A TSET is constructed by the dual enhancement. We validate the proposed method on both public and industrial datasets. The experimental results show that our method can outperform the mainstream baseline methods. Note to practitioners—The model in this paper is applied to fault prediction in industrial automation processes. The log and fault record data generated in industrial processes are natural time series data. Time series prediction models generated in the field of Natural language processing need a lot of corpus data to generate reasonable inference results. However, the fault data of industrial processes usually cannot reach an order of magnitude sufficient for these models to operate well. On the other hand, these corpus based data models are not friendly to industrial fault data. The model in this paper is established from two aspects: data enhancement and temporal correlation enhancement, so that the industrial fault sample data can meet the needs of the prediction model as much as possible. By enhancing temporal correlation features, the prediction model becomes friendly to industrial temporal fault data. The method is validated through experiments on actual industrial process data and public datasets. In practical applications, inputting data into the model proposed in the paper generates prediction results based on time series, and distinguishes whether the predicted data is a fault, thereby providing fault warning, which is helpful for the automation of the entire industrial life cycle.

Valve Stiction Detection Using Multitimescale Feature Consistent Constraint for Time-Series Data

Multiple-Timescale Feature Learning Strategy for Valve Stiction Detection Based on Convolutional Neural Network

Unsupervised Feature Learning with Data Augmentation for Control Valve Stiction Detection

Industrial Fault Detection Based on Time-Frequency Distillation Autoencoder

Multi Time Scale Inception-Time Network for Soft Sensor of Blast Furnace Ironmaking Process

Deep Learning With Tensor Factorization Layers For Sequential Fault Diagnosis And Industrial Process Monitoring

Debiased Contrastive Learning for Time-Series Representation Learning and Fault Detection

STAGED: A Spatial-Temporal Aware Graph Encoder–Decoder for Fault Diagnosis in Industrial Processes

A deep learning methodology based on adaptive multiscale CNN and enhanced highway LSTM for industrial process fault diagnosis

A network structure for industrial process fault diagnosis based on hyper feature extraction and stacked LSTM

A Time-Distributed Spatiotemporal Feature Learning Method for Machine Health Monitoring with Multi-Sensor Time Series.

Rapid diagnosis of proportional valve pilot stage stiction fault via dynamic model-based temporal features

Interactive spatiotemporal LSTM approach for enhanced industrial fault diagnosis

Enhanced Fault Diagnosis in Time-series Data by Deep Learning

Time Series Fault Prediction Via Dual Enhancement

An adaptive spatiotemporal feature learning approach for fault diagnosis in complex systems

Semi-supervised LSTM with Historical Feature Fusion Attention for Temporal Sequence Dynamic Modeling in Industrial Processes

A novel self-supervised representation learning framework based on time-frequency alignment and interaction for mechanical fault diagnosis

Dislocated Time Series Convolutional Neural Architecture: an Intelligent Fault Diagnosis Approach for Electric Machine

A Novel Fault Diagnosis Approach Based on Correlation Analysis and Improved Two-Stream Neural Networks

Early Fault Detection Approach with Deep Architectures