Abstract:Accurate detection and diagnosis of abnormal behaviors such as network attacks from multivariate time series (MTS) are crucial for ensuring the stable and effective operation of industrial cyber-physical systems (CPS). However, existing researches pay little attention to the logical dependencies among system working states, and have difficulties in explaining the evolution mechanisms of abnormal signals. To reveal the spatio-temporal association relationships and evolution mechanisms of the working states of industrial CPS, this paper proposes a fine-grained adaptive anomaly diagnosis method (i.e. MAD-Transformer) to identify and diagnose anomalies in MTS. MAD-Transformer first constructs a temporal state matrix to characterize and estimate the change patterns of the system states in the temporal dimension. Then, to better locate the anomalies, a spatial state matrix is also constructed to capture the inter-sensor state correlation relationships within the system. Subsequently, based on these two types of state matrices, a three-branch structure of series-temporal-spatial attention module is designed to simultaneously capture the series, temporal, and space dependencies among MTS. Afterwards, three associated alignment loss functions and a reconstruction loss are constructed to jointly optimize the model. Finally, anomalies are determined and diagnosed by comparing the residual matrices with the original matrices. We conducted comparative experiments on five publicly datasets spanning three application domains (service monitoring, spatial and earth exploration, and water treatment), along with a petroleum refining simulation dataset collected by ourselves. The results demonstrate that MAD-Transformer can adaptively detect fine-grained anomalies with short duration, and outperforms the state-of-the-art baselines in terms of noise robustness and localization performance.

Fine-Grained Multivariate Time Series Anomaly Detection in IoT

Accurate Anomaly Detection Leveraging Knowledge-enhanced GAT

GTAD: Graph and Temporal Neural Network for Multivariate Time Series Anomaly Detection

Unsupervised Anomaly Detection for IoT-Based Multivariate Time Series: Existing Solutions, Performance Analysis and Future Directions

Anomaly Detection with Graph Attention Network for Multimodal IoT Data Monitoring

MGAD: Mutual Information and Graph Embedding Based Anomaly Detection in Multivariate Time Series

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

Graph Attention Network and Informer for Multivariate Time Series Anomaly Detection

Learning Graph Structures with Transformer for Multivariate Time Series Anomaly Detection in IoT

Dynamic Deep Graph Convolution with Enhanced Transformer Networks for Time Series Anomaly Detection in IoT

MFAM-AD: an anomaly detection model for multivariate time series using attention mechanism to fuse multi-scale features

Real-Time Deep Anomaly Detection Framework for Multivariate Time-Series Data in Industrial IoT

TSMAE: A Novel Anomaly Detection Approach for Internet of Things Time Series Data Using Memory-Augmented Autoencoder

TFAD: A Decomposition Time Series Anomaly Detection Architecture with Time-Frequency Analysis

Hybrid Anomaly Detection via Multihead Dynamic Graph Attention Networks for Multivariate Time Series

Drift-aware Anomaly Detection for Non-stationary Time Series

An Anomaly Detection Algorithm Selection Service for IoT Stream Data Based on Tsfresh Tool and Genetic Algorithm

Unsupervised Spatio-Temporal State Estimation for Fine-grained Adaptive Anomaly Diagnosis of Industrial Cyber-physical Systems

TimeTector: A Twin-Branch Approach for Unsupervised Anomaly Detection in Livestock Sensor Noisy Data (TT-TBAD)

Multivariate Time-Series Anomaly Detection via Graph Attention Network

MST-GAT: A Multimodal Spatial-Temporal Graph Attention Network for Time Series Anomaly Detection