Abstract:Multiple variable time series anomaly detection plays a significant role in fields such as AIOps and intelligent healthcare. However, time series often lack labels, and anomalies are infrequent compared to normal sequences. Moreover, high-dimensional nonlinear correlations and substantial distribution variations among variables exist in multivariate time series. These challenges make it difficult for the model to accurately model time series. While contemporary reconstruction-based models address challenges of data scarcity and time series modeling through GAN frameworks, little attention has been given to mitigating the substantial differences in variable distributions among multiple time series. This paper proposes the Variable-wise Generative Adversarial Transformer (VGAT) for achieving unsupervised anomaly detection, with WGAN as the training framework and Transformer as the fundamental structure for the Duplicator and Discriminator. Firstly, VGAT makes the Generator act as the Duplicator, reconstructing samples through direct replication, simplifying the model structure, and enhancing efficiency. Secondly, VGAT employs the Soft-DTW regularization to facilitate a more authentic replication of normal sequences by the Duplicator. Most importantly, VGAT introduces the Variable-wise Gate, dynamically calculating a gate for each variable in the multivariate time series to balance the differences in variable distributions. After VGAT generates anomaly scores, the SPOT algorithm based on Extreme Value Theory (EVT) automatically computes the threshold, enhancing the adaptability to different data of the model. VGAT demonstrates state-of-the-art (SOTA) performance, surpassing baselines on public datasets. Notably, as the dimensionality of the series increases, VGAT exhibits more significant improvements. On WADI dataset, VGAT achieves an impressive 68.19% enhancement in F1-score, showcasing remarkable progress compared to the current SOTA model.

Hybrid Graph Transformer Networks for Multivariate Time Series Anomaly Detection

Disentangled Dynamic Deviation Transformer Networks for Multivariate Time Series Anomaly Detection

Learning Graph Structures with Transformer for Multivariate Time Series Anomaly Detection in IoT

Dynamic Deep Graph Convolution with Enhanced Transformer Networks for Time Series Anomaly Detection in IoT

Multivariate Time-Series Anomaly Detection based on Enhancing Graph Attention Networks with Topological Analysis

Graph Transformer Network Incorporating Sparse Representation for Multivariate Time Series Anomaly Detection

LGAT: A Novel Model for Multivariate Time Series Anomaly Detection with Imporved Anomaly Transformer and Learning Graph Structures

Multivariate Time-Series Anomaly Detection via Graph Attention Network

Transformer-based multivariate time series anomaly detection using inter-variable attention mechanism

From anomaly detection to classification with graph attention and transformer for multivariate time series

GTAD: Graph and Temporal Neural Network for Multivariate Time Series Anomaly Detection

Hybrid Anomaly Detection via Multihead Dynamic Graph Attention Networks for Multivariate Time Series

An enhanced abnormal information expression spatiotemporal model for anomaly detection in multivariate time-series

CANet: Convolutional Attention-based Network for Multivariate Time Series Anomaly Detection

Multivariate Time Series Anomaly Detection with Fourier Time Series Transformer

HybridAD: A Hybrid Model-Driven Anomaly Detection Approach for Multivariate Time Series

Graph Attention Network and Informer for Multivariate Time Series Anomaly Detection

Variable-wise generative adversarial transformer in multivariate time series anomaly detection

Variational transformer-based anomaly detection approach for multivariate time series

A Multi-scale Parallel Unsupervised Model for Multivariate Time Series Anomaly Detection

DTAAD: Dual Tcn-Attention Networks for Anomaly Detection in Multivariate Time Series Data