Abstract:Accurate detection and diagnosis of abnormal behaviors such as network attacks from multivariate time series (MTS) are crucial for ensuring the stable and effective operation of industrial cyber-physical systems (CPS). However, existing researches pay little attention to the logical dependencies among system working states, and have difficulties in explaining the evolution mechanisms of abnormal signals. To reveal the spatio-temporal association relationships and evolution mechanisms of the working states of industrial CPS, this paper proposes a fine-grained adaptive anomaly diagnosis method (i.e. MAD-Transformer) to identify and diagnose anomalies in MTS. MAD-Transformer first constructs a temporal state matrix to characterize and estimate the change patterns of the system states in the temporal dimension. Then, to better locate the anomalies, a spatial state matrix is also constructed to capture the inter-sensor state correlation relationships within the system. Subsequently, based on these two types of state matrices, a three-branch structure of series-temporal-spatial attention module is designed to simultaneously capture the series, temporal, and space dependencies among MTS. Afterwards, three associated alignment loss functions and a reconstruction loss are constructed to jointly optimize the model. Finally, anomalies are determined and diagnosed by comparing the residual matrices with the original matrices. We conducted comparative experiments on five publicly datasets spanning three application domains (service monitoring, spatial and earth exploration, and water treatment), along with a petroleum refining simulation dataset collected by ourselves. The results demonstrate that MAD-Transformer can adaptively detect fine-grained anomalies with short duration, and outperforms the state-of-the-art baselines in terms of noise robustness and localization performance.

LSTD-MTS: Anomaly Detection with Capturing Long-Term Spatio-Temporal Dependence for Multi-dimensional Time Series

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

MST-GAT: A Multimodal Spatial-Temporal Graph Attention Network for Time Series Anomaly Detection

GTAD: Graph and Temporal Neural Network for Multivariate Time Series Anomaly Detection

HCL-MTSAD: Hierarchical Contrastive Consistency Learning for Accurate Detection of Industrial Multivariate Time Series Anomalies

Anomaly Detection Model for Large-scale Industrial Systems Using Transfer Entropy and Graph Attention Network

DTAAD: Dual Tcn-attention networks for anomaly detection in multivariate time series data

Dynamic Deep Graph Convolution with Enhanced Transformer Networks for Time Series Anomaly Detection in IoT

Unsupervised Spatio-Temporal State Estimation for Fine-grained Adaptive Anomaly Diagnosis of Industrial Cyber-physical Systems

An enhanced abnormal information expression spatiotemporal model for anomaly detection in multivariate time-series

Correlation-aware Spatial-Temporal Graph Learning for Multivariate Time-series Anomaly Detection

Hybrid Anomaly Detection via Multihead Dynamic Graph Attention Networks for Multivariate Time Series

Learning Graph Structures with Transformer for Multivariate Time Series Anomaly Detection in IoT

Contaminated Multivariate Time-Series Anomaly Detection with Spatio-Temporal Graph Conditional Diffusion Models

TimeTector: A Twin-Branch Approach for Unsupervised Anomaly Detection in Livestock Sensor Noisy Data (TT-TBAD)

LGAT: A Novel Model for Multivariate Time Series Anomaly Detection with Imporved Anomaly Transformer and Learning Graph Structures

Self-Supervised Spatial-Temporal Normality Learning for Time Series Anomaly Detection

Rapidly progressive pneumonia in a young man.

MSDG: Multi-Scale Dynamic Graph Neural Network for Industrial Time Series Anomaly Detection

LPC-AD: Fast and Accurate Multivariate Time Series Anomaly Detection via Latent Predictive Coding