Abstract:Accurate detection and diagnosis of abnormal behaviors such as network attacks from multivariate time series (MTS) are crucial for ensuring the stable and effective operation of industrial cyber-physical systems (CPS). However, existing researches pay little attention to the logical dependencies among system working states, and have difficulties in explaining the evolution mechanisms of abnormal signals. To reveal the spatio-temporal association relationships and evolution mechanisms of the working states of industrial CPS, this paper proposes a fine-grained adaptive anomaly diagnosis method (i.e. MAD-Transformer) to identify and diagnose anomalies in MTS. MAD-Transformer first constructs a temporal state matrix to characterize and estimate the change patterns of the system states in the temporal dimension. Then, to better locate the anomalies, a spatial state matrix is also constructed to capture the inter-sensor state correlation relationships within the system. Subsequently, based on these two types of state matrices, a three-branch structure of series-temporal-spatial attention module is designed to simultaneously capture the series, temporal, and space dependencies among MTS. Afterwards, three associated alignment loss functions and a reconstruction loss are constructed to jointly optimize the model. Finally, anomalies are determined and diagnosed by comparing the residual matrices with the original matrices. We conducted comparative experiments on five publicly datasets spanning three application domains (service monitoring, spatial and earth exploration, and water treatment), along with a petroleum refining simulation dataset collected by ourselves. The results demonstrate that MAD-Transformer can adaptively detect fine-grained anomalies with short duration, and outperforms the state-of-the-art baselines in terms of noise robustness and localization performance.

HKMF-T: Recover from Blackouts in Tagged Time Series with Hankel Matrix Factorization

Hankel Matrix Factorization for Tagged Time Series to Recover Missing Values During Blackouts

HTF: An Effective Algorithm for Time Series to Recover Missing Blocks

Temporal Difference Learning Based Critical Component Identifying Method with Cascading Failure Data in Power Systems

Bayesian High-Rank Hankel Matrix Completion for Nonlinear Synchrophasor Data Recovery

Precise Recovery of Corrupted Synchrophasors Based on Autoregressive Bayesian Low-Rank Factorization and Adaptive K-Medoids Clustering

Power Grid Missing Data Filling Method Based on Historical Data Mining Assisted Multi-dimensional Scenario Analysis

Missing Data Imputation in GNSS Monitoring Time Series Using Temporal and Spatial Hankel Matrix Factorization

Time Series Data-Driven Online Prognosis of Wind Turbine Faults in Presence of SCADA Data Loss

Graph Spatiotemporal Process for Multivariate Time Series Anomaly Detection with Missing Values

Recovering Multiple Nonnegative Time Series From a Few Temporal Aggregates

CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patching

BayOTIDE: Bayesian Online Multivariate Time series Imputation with functional decomposition

Robust Multi-Dimensional Time Series Forecasting

Probabilistic Temporal Fusion Transformers for Large-Scale KPI Anomaly Detection

Unsupervised Spatio-Temporal State Estimation for Fine-grained Adaptive Anomaly Diagnosis of Industrial Cyber-physical Systems

Forecasting Urban Traffic States with Sparse Data Using Hankel Temporal Matrix Factorization

TFAD: A Decomposition Time Series Anomaly Detection Architecture with Time-Frequency Analysis

KNN-ADMM Based Online Missing Data Recovery in Electricity Markets

Anomaly Detection on Seasonal Metrics via Robust Time Series Decomposition