Abstract:Recent unsupervised framework-based anomaly detection methods in Internet of Things (IoT) have been proved successful by learning temporal pattern representations from normal time series data. However, such methods have long suffered from weakened normal-abnormal boundary incurred by discrimination-insufficient temporal pattern representations, due to: (1) normal time series often suffer from some unprocessed abnormal noise, interfering with model’s discriminative representations between normal and abnormal points. (2) Previous methods rarely focus on contextual semantic features of time series that are also crucial for constructing discriminative representations. In this paper, we propose MPFormer, a transformer-based multi-patch contrastive learning framework. This novel framework leverages contrastive learning to guide discriminative feature learning. It incorporates a data augmentation strategy to generate positive samples and maximizes the similarity between positive sample pairs, thereby capturing inherent representations of normal temporal patterns and enhancing robust discrimination ability to abnormal noise. To further facilitate discriminative representation modeling, we divide input time series into multiple patches, and design a transformer-based dual attention module to explore contextual semantic features in both inter-patch and intra-patch views. Benefiting from discriminative representations being modeled, MPFormer effectively strengthens the normal-abnormal boundary, thus improving detection accuracy. Experimental results on six widely adopted datasets demonstrate that our proposed MPFormer outperforms existing baseline methods.

Anomaly Detection for Multivariate Time Series Based on Contrastive Learning and Autoformer

CANet: Convolutional Attention-based Network for Multivariate Time Series Anomaly Detection

Multivariate Time-Series Anomaly Detection via Graph Attention Network

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

TimeAutoAD: Autonomous Anomaly Detection With Self-Supervised Contrastive Loss for Multivariate Time Series

A Contrastive Autoencoder with Multi-Resolution Segment-Consistency Discrimination for Multivariate Time Series Anomaly Detection

Spatial-Temporal Dependency Based Multivariate Time Series Anomaly Detection for Industrial Processes

A Time Series Anomaly Detection Method Based on Series-Parallel Transformers with Spatial and Temporal Association Discrepancies

An adversarial contrastive autoencoder for robust multivariate time series anomaly detection

Anomaly Detection for Multivariate Time Series in IoT Using Discrete Wavelet Decomposition and Dual Graph Attention Networks

An enhanced abnormal information expression spatiotemporal model for anomaly detection in multivariate time-series

Anomaly Detection Via Graph Attention Networks-Augmented Mask Autoregressive Flow for Multivariate Time Series

A Graph Attention Network-Based Model for Anomaly Detection in Multivariate Time Series

MPFormer: Multi-Patch Transformer for Multivariate Time Series Anomaly Detection with Contrastive Learning

Contrastive autoencoder for anomaly detection in multivariate time series

Robust Anomaly Detection for Multivariate Time Series Through Temporal GCNs and Attention-Based VAE

Hybrid Graph Transformer Networks for Multivariate Time Series Anomaly Detection

Adversarial Graph Neural Network for Multivariate Time Series Anomaly Detection

A two-stage adversarial Transformer based approach for multivariate industrial time series anomaly detection

Using Multi-Scale Convolution Fusion and Memory-Augmented Adversarial Autoencoder to Detect Diverse Anomalies in Multivariate Time Series

DTAAD: Dual Tcn-attention networks for anomaly detection in multivariate time series data