Abstract:Time series data are pervasive in varied real-world applications, and accurately identifying anomalies in time series is of great importance. Many current methods are insufficient to model long-term dependence, whereas some anomalies can be only identified through long temporal contextual information. This may finally lead to disastrous outcomes due to false negatives of these anomalies. Prior arts employ Transformers (i.e., a neural network architecture that has powerful capability in modeling long-term dependence and global association) to alleviate this problem; however, Transformers are insensitive in sensing local context, which may neglect subtle anomalies. Therefore, in this paper, we propose a local-adaptive Transformer based on cross-correlation for time series anomaly detection, which unifies both global and local information to capture comprehensive time series patterns. Specifically, we devise a cross-correlation mechanism by employing causal convolution to adaptively capture local pattern variation, offering diverse local information into the long-term temporal learning process. Furthermore, a novel optimization objective is utilized to jointly optimize reconstruction of the entire time series and matrix derived from cross-correlation mechanism, which prevents the cross-correlation from becoming trivial in the training phase. The generated cross-correlation matrix reveals underlying interactions between dimensions of multivariate time series, which provides valuable insights into anomaly diagnosis. Extensive experiments on six real-world datasets demonstrate that our model outperforms state-of-the-art competing methods and achieves 6.8%-27.5% <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$F_{1}$</tex> score improvement. Our method also has good anomaly interpretability and is effective for anomaly diagnosis.

MPFormer: Multi-Patch Transformer for Multivariate Time Series Anomaly Detection with Contrastive Learning

Learning Discrimination from Contaminated Data: Multi-Instance Learning for Unsupervised Anomaly Detection

TCF-Trans: Temporal Context Fusion Transformer for Anomaly Detection in Time Series

Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy

A two-stage adversarial Transformer based approach for multivariate industrial time series anomaly detection

Refining One-Class Representation: A Unified Transformer for Unsupervised Time-Series Anomaly Detection

DDMT: Denoising Diffusion Mask Transformer Models for Multivariate Time Series Anomaly Detection

Local-Adaptive Transformer for Multivariate Time Series Anomaly Detection and Diagnosis.

Multivariate time series anomaly detection with adversarial transformer architecture in the Internet of Things

MEMTO: Memory-guided Transformer for Multivariate Time Series Anomaly Detection

Anomaly detection in surveillance videos using Transformer with margin learning

UTRAD: Anomaly detection and localization with U-Transformer

MSTAD: A masked subspace-like transformer for multi-class anomaly detection

A Multi-scale Patch Mixer Network for Time Series Anomaly Detection

An adversarial contrastive autoencoder for robust multivariate time series anomaly detection

Unsupervised Spatio-Temporal State Estimation for Fine-grained Adaptive Anomaly Diagnosis of Industrial Cyber-physical Systems

Transformer-based contrastive learning framework for image anomaly detection

Multiview Graph Contrastive Learning for Multivariate Time-Series Anomaly Detection in IoT

Multivariate Time Series Anomaly Detection with Fourier Time Series Transformer

Self-supervised multi-transformation learning for time series anomaly detection

EdgeConvFormer: Dynamic Graph CNN and Transformer based Anomaly Detection in Multivariate Time Series