Abstract:Deep learning is an appropriate methodology for modeling complex industrial data in the field of soft sensors, owing to its powerful feature representation capability. Given the nonlinear and dynamic nature of the process industry, the key challenge for soft sensor technology is to effectively mine dynamic information from long sequences and accurately extract features of relevance to quality. A dual temporal attention mechanism-based convolutional long short-term memory network (DTA-ConvLSTM) under an encoder-decoder framework is proposed as a soft sensor model to acquire quality-relevant dynamic features from serial data. Considering different influences of process variables for prediction at multiple time steps and various locations, ConvLSTM and temporal self-attention mechanism are utilized as the encoder to adaptively fuse spatiotemporal features and capture long-term dynamic properties of process in order to capture the trends of industrial variables. Furthermore, a quality-driven temporal attention mechanism is employed throughout the decoding process to dynamically select relevant features to more accurately track quality changes. The encoder-decoder model meticulously analyses the interactions between process and quality variables by incorporating dual-sequence dynamic information to improve the prediction performance. The validity and superiority of the DTA-ConvLSTM model was validated on two industrial case studies of the debutanizer column and sulfur recovery unit. Compared to the traditional LSTM model, the proposed model demonstrated a substantial improvement with the accuracy R2 up to 97.3% and 94.9% and the root mean square error reducing to 0.122 and 0.022.

Dual-attention LSTM autoencoder for fault detection in industrial complex dynamic processes

Dynamic Convolutional Gated Recurrent Unit Attention Auto-Encoder for Feature Learning and Fault Detection in Dynamic Industrial Processes.

Nonlinear Dynamic System Based on SAE-LDS Model for Fault Diagnosis

Stacked Spatial–Temporal Autoencoder for Quality Prediction in Industrial Processes

Convolutional Long Short-Term Memory Autoencoder-Based Feature Learning for Fault Detection in Industrial Processes

Quality-related Fault Detection for Dynamic Process Based on Quality-Driven Long Short-Term Memory Network and Autoencoder

Fault detection of industrial processes using attention-based gated recurrent unit autoencoder with skip connection

A Review on Autoencoder Based Representation Learning for Fault Detection and Diagnosis in Industrial Processes

An Intelligent Fault Detection Method Based on Sparse Auto-Encoder for Industrial Process Systems: A Case Study on Tennessee Eastman Process Chemical System

Industrial Process Fault Detection Based on Siamese Recurrent Autoencoder

Decentralized Adaptively Weighted Stacked Autoencoder-Based Incipient Fault Detection for Nonlinear Industrial Processes.

Fault detection in automated production systems based on a long short-term memory autoencoder

Aero-Engine Fault Detection with an LSTM Auto-Encoder Combined with a Self-Attention Mechanism

Fault Detection and Diagnosis Using Combined Autoencoder and Long Short-Term Memory Network

Semi-supervised Fault Classification Based on Dynamic Sparse Stacked Auto-Encoders Model

STAGED: A Spatial-Temporal Aware Graph Encoder–Decoder for Fault Diagnosis in Industrial Processes

Residual Squeeze-and-excitation Convolutional Auto-Encoder for Fault Detection and Diagnosis in Complex Industrial Processes

Adaptive Anomaly Detection in Industrial Systems: an EVT-DTS Approach with LSTM Autoencoders

Dual Temporal Attention Mechanism-based Convolutional LSTM Model for Industrial Dynamic Soft Sensor

Autoencoder Based High-Dimensional Data Fault Detection System

Distributed-ensemble Stacked Autoencoder Model for Non-Linear Process Monitoring