Abstract:Cyber–physical systems (CPSs) serve as the pivotal core of Internet of Things (IoT) infrastructures, such as smart grids and intelligent transportation, deploying interconnected sensing devices to monitor operating status. With increasing decentralization, the surge in sensor devices expands the potential vulnerability to cyber attacks. It is imperative to conduct anomaly detection research on the multivariate time series data that these sensors produce to bolster the security of distributed CPSs. However, the high dimensionality, absence of anomaly labels in real-world datasets, and intricate non-linear relationships among sensors present considerable challenges in formulating effective anomaly detection algorithms. Recent deep-learning methods have achieved progress in the field of anomaly detection. Yet, many methods either rely on statistical models that struggle to capture non-linear relationships or use conventional deep learning models like CNN and LSTM, which do not explicitly learn inter-variable correlations. In this study, we propose a novel unsupervised anomaly detection method that integrates Sparse Autoencoder with Graph Transformer network (SGTrans). SGTrans leverages Sparse Autoencoder for the dimensionality reduction and reconstruction of high-dimensional time series, thus extracting meaningful hidden representations. Then, the multivariate time series are mapped into a graph structure. We introduce a multi-head attention mechanism from Transformer into graph structure learning, constructing a Graph Transformer network forecasting module. This module performs attentive information propagation between long-distance sensor nodes and explicitly models the complex temporal dependencies among them to enhance the prediction of future behaviors. Extensive experiments and evaluations on three publicly available real-world datasets demonstrate the effectiveness of our approach.

An Unsupervised Spatiotemporal Graphical Modeling Approach to Anomaly Detection in Distributed CPS

An Unsupervised Anomaly Detection Approach Using Energy-Based Spatiotemporal Graphical Modeling

Root-cause analysis for time-series anomalies via spatiotemporal graphical modeling in distributed complex systems

An Unsupervised Framework for Anomaly Detection in a Water Treatment System

Data-Driven Root-Cause Analysis For Distributed System Anomalies

Root-cause analysis for time-series anomalies via spatiotemporal causal graphical modeling.

DPDGAD: A Dual-Process Dynamic Graph-based Anomaly Detection for multivariate time series analysis in cyber-physical systems

Learning Spatial Graph Structure for Multivariate KPI Anomaly Detection in Large-Scale Cyber-Physical Systems.

Unsupervised Spatio-Temporal State Estimation for Fine-grained Adaptive Anomaly Diagnosis of Industrial Cyber-physical Systems

An unsupervised spatiotemporal graphical modeling approach for wind turbine condition monitoring

Reconstruction-based Multi-Scale Anomaly Detection for Cyber-Physical Systems

Tracking Real-time Anomalies in Cyber-Physical Systems Through Dynamic Behavioral Analysis

Graph Transformer Network Incorporating Sparse Representation for Multivariate Time Series Anomaly Detection

Spatiotemporal Polynomial Graph Neural Network for Anomaly Detection of Complex Systems

A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems

Deep Learning-based Anomaly Detection in Cyber-physical Systems

A Hierarchical Approach to Conditional Random Fields for System Anomaly Detection

An Anomaly Detection Algorithm for Spatiotemporal Data Based on Attribute Correlation.

Monitoring industrial control systems via spatio-temporal graph neural networks

Physics-informed gated recurrent graph attention unit network for anomaly detection in industrial cyber-physical systems

Subtle Anomaly Detection in Dynamic Networks Using Graph Spectra