Abstract:Cyber–physical systems (CPSs) serve as the pivotal core of Internet of Things (IoT) infrastructures, such as smart grids and intelligent transportation, deploying interconnected sensing devices to monitor operating status. With increasing decentralization, the surge in sensor devices expands the potential vulnerability to cyber attacks. It is imperative to conduct anomaly detection research on the multivariate time series data that these sensors produce to bolster the security of distributed CPSs. However, the high dimensionality, absence of anomaly labels in real-world datasets, and intricate non-linear relationships among sensors present considerable challenges in formulating effective anomaly detection algorithms. Recent deep-learning methods have achieved progress in the field of anomaly detection. Yet, many methods either rely on statistical models that struggle to capture non-linear relationships or use conventional deep learning models like CNN and LSTM, which do not explicitly learn inter-variable correlations. In this study, we propose a novel unsupervised anomaly detection method that integrates Sparse Autoencoder with Graph Transformer network (SGTrans). SGTrans leverages Sparse Autoencoder for the dimensionality reduction and reconstruction of high-dimensional time series, thus extracting meaningful hidden representations. Then, the multivariate time series are mapped into a graph structure. We introduce a multi-head attention mechanism from Transformer into graph structure learning, constructing a Graph Transformer network forecasting module. This module performs attentive information propagation between long-distance sensor nodes and explicitly models the complex temporal dependencies among them to enhance the prediction of future behaviors. Extensive experiments and evaluations on three publicly available real-world datasets demonstrate the effectiveness of our approach.

Graph Neural Network-Based Anomaly Detection in Multivariate Time Series

Grouped Graph Neural Networks for Anomaly Detection in Time Series

Multivariate Time-Series Anomaly Detection via Graph Attention Network

Spatial-Temporal Graph Deviation Neural Networks for Anomaly Detection in Time Series

Correlation-aware Spatial-Temporal Graph Learning for Multivariate Time-series Anomaly Detection

Learning Graph Neural Networks for Multivariate Time Series Anomaly Detection

Multi-Scale Dynamic Graph Learning for Time Series Anomaly Detection (student Abstract)

Graph Attention Network and Informer for Multivariate Time Series Anomaly Detection

Masked Graph Neural Networks for Unsupervised Anomaly Detection in Multivariate Time Series

Multivariate Time Series Anomaly Detection via Dynamic Graph Forecasting

GTAD: Graph and Temporal Neural Network for Multivariate Time Series Anomaly Detection

Graph Transformer Network Incorporating Sparse Representation for Multivariate Time Series Anomaly Detection

Multivariate Time-Series Anomaly Detection based on Enhancing Graph Attention Networks with Topological Analysis

Graph-Based Time Series Decomposition for Multi-source Sensors Anomaly Detection

Disentangled Dynamic Deviation Transformer Networks for Multivariate Time Series Anomaly Detection

CANet: Convolutional Attention-based Network for Multivariate Time Series Anomaly Detection

Hybrid Anomaly Detection via Multihead Dynamic Graph Attention Networks for Multivariate Time Series

Multivariate time series anomaly detection via dynamic graph attention network and Informer

An Unsupervised Learning-Based Multivariate Anomaly Detection Method for Dynamic Attention Graphs

Event2Graph: Event-driven Bipartite Graph for Multivariate Time-series Anomaly Detection

AD-Graph: Weakly Supervised Anomaly Detection Graph Neural Network