Abstract:Anomaly detection plays a critical role in ensuring safe, smooth, and efficient operation of machinery and equipment in industrial environments. With the wide deployment of multimodal sensors and the rapid development of Internet of Things (IoT), the data generated in modern industrial production has become increasingly diverse and complex. However, traditional methods for anomaly detection based on a single data source cannot fully utilize multimodal data to capture anomalies in industrial systems. To address this challenge, we propose a new model for anomaly detection in industrial environments using multimodal temporal data. This model integrates an attention-based autoencoder (AAE) and a generative adversarial network (GAN) to capture and fuse rich information from different data sources. Specifically, the AAE captures time-series dependencies and relevant features in each modality, and the GAN introduces adversarial regularization to enhance the model's ability to reconstruct normal time-series data. We conduct extensive experiments on real industrial data containing both measurements from a distributed control system (DCS) and acoustic signals, and the results demonstrate the performance superiority of the proposed model over the state-of-the-art TimesNet for anomaly detection, with an improvement of 5.6% in F1 score.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to conduct anomaly detection using multi - modal time - series data in an industrial environment. Specifically, traditional methods based on a single data source are unable to fully utilize multi - modal data to capture anomalies in industrial systems. With the rapid development of Industry 4.0 and the Internet of Things (IoT), the data generated in modern industrial production has become increasingly diverse and complex. These data come from a variety of sensors, devices and production systems, including multiple modalities such as temperature, pressure, vibration, current, acoustic signals and images. However, due to the large volume and complexity of multi - modal data, traditional single - data - source anomaly detection methods are unable to fully utilize these data and often fail to respond in a timely manner. To meet this challenge, the paper proposes a new industrial anomaly detection model, which uses an Attention - based Auto - Encoder (AAE) and a Generative Adversarial Network (GAN) to capture and fuse the rich information of different data sources. Specifically, the AAE is used to capture the time - series dependencies and relevant features of each modality, while the GAN enhances the model's ability to reconstruct normal time - series data by introducing adversarial regularization. The main contributions of the paper include: 1. Proposing a method of using an attention mechanism in an auto - encoder to extract sequence context information from the original time - series data, improving the model's feature extraction ability for each modality data point. 2. Designing a multi - modal feature fusion module to fuse multiple features such as temperature, vibration and acoustic signals, improving the accuracy of anomaly detection. This module improves the model's generalization ability, robustness and applicability in various practical scenarios. 3. Collecting multi - modal data in a real - world industrial environment and experimentally verifying that the proposed model outperforms existing methods in terms of anomaly detection performance. Through these innovations, the paper aims to improve the accuracy and efficiency of anomaly detection in an industrial environment, thereby ensuring the safe, stable and efficient operation of production equipment.

MFGAN: Multimodal Fusion for Industrial Anomaly Detection Using Attention-Based Autoencoder and Generative Adversarial Network

Data anomaly detection for structural health monitoring using a combination network of GANomaly and CNN

Anomaly Detection of GAN Industrial Image Based on Attention Feature Fusion

A Novel Multi-dimensional Time-series Data Anomaly Detection Model Based on Generative Adversarial Network Aided Autoencoder

Ensemble Data Augmentation for Imbalanced Fault Diagnosis.

GAN-based Data Augmentation Strategy for Sensor Anomaly Detection in Industrial Robots

mixed attention auto encoder for multi-class industrial anomaly detection

Deep Learning-Based Cyber–Physical Feature Fusion for Anomaly Detection in Industrial Control Systems

An Attention-Based Deep Generative Model for Anomaly Detection in Industrial Control Systems

Anomaly Detection Method for Industrial Control System Operation Data Based on Time-Frequency Fusion Feature Attention Encoding

Robust Unsupervised Anomaly Detection Via Multi-Time Scale DCGANs with Forgetting Mechanism for Industrial Multivariate Time Series

Anomaly Detection with Memory-augmented Adversarial Autoencoder Networks for Industry 5.0

Features Masked Auto-Encoder-Based Anomaly Detection in Process Industry

Multimodal Industrial Anomaly Detection via Hybrid Fusion

Hybrid Anomaly Detection via Multihead Dynamic Graph Attention Networks for Multivariate Time Series

Memory-Enhanced Spatial-Temporal Encoding Framework for Industrial Anomaly Detection System

An Unsupervised Spatiotemporal Fusion Network Augmented with Random Mask and Time-Relative Information Modulation for Anomaly Detection of Machines with Multiple Measuring Points.

Attention-stacked Generative Adversarial Network (AS-GAN)-empowered Sensor Data Augmentation for Online Monitoring of Manufacturing System

Multi-scale Anomaly Detection for Big Time Series of Industrial Sensors

Data-driven Unsupervised Anomaly Detection of Manufacturing Processes with Multi-Scale Prototype Augmentation and Multi-Sensor Data

A Machine Vision-based Realtime Anomaly Detection Method for Industrial Products Using Deep Learning