Abstract:Cyber–physical systems (CPSs) serve as the pivotal core of Internet of Things (IoT) infrastructures, such as smart grids and intelligent transportation, deploying interconnected sensing devices to monitor operating status. With increasing decentralization, the surge in sensor devices expands the potential vulnerability to cyber attacks. It is imperative to conduct anomaly detection research on the multivariate time series data that these sensors produce to bolster the security of distributed CPSs. However, the high dimensionality, absence of anomaly labels in real-world datasets, and intricate non-linear relationships among sensors present considerable challenges in formulating effective anomaly detection algorithms. Recent deep-learning methods have achieved progress in the field of anomaly detection. Yet, many methods either rely on statistical models that struggle to capture non-linear relationships or use conventional deep learning models like CNN and LSTM, which do not explicitly learn inter-variable correlations. In this study, we propose a novel unsupervised anomaly detection method that integrates Sparse Autoencoder with Graph Transformer network (SGTrans). SGTrans leverages Sparse Autoencoder for the dimensionality reduction and reconstruction of high-dimensional time series, thus extracting meaningful hidden representations. Then, the multivariate time series are mapped into a graph structure. We introduce a multi-head attention mechanism from Transformer into graph structure learning, constructing a Graph Transformer network forecasting module. This module performs attentive information propagation between long-distance sensor nodes and explicitly models the complex temporal dependencies among them to enhance the prediction of future behaviors. Extensive experiments and evaluations on three publicly available real-world datasets demonstrate the effectiveness of our approach.

TranBF: Deep Transformer Networks and Bayesian Filtering for Time Series Anomalous Signal Detection in Cyber-physical Systems

An Unsupervised Framework for Anomaly Detection in a Water Treatment System

TCF-Trans: Temporal Context Fusion Transformer for Anomaly Detection in Time Series

Anomalous Signal Detection for Cyber-Physical Systems Using Interpretable Causal Neural Network

TFD-Net: Transformer Deviation Network for Weakly Supervised Anomaly Detection

Graph Transformer Network Incorporating Sparse Representation for Multivariate Time Series Anomaly Detection

BTAD: A binary transformer deep neural network model for anomaly detection in multivariate time series data

A New Perspective on Time Series Anomaly Detection: Faster Patch-based Broad Learning System

TDS-Net: Transformer Enhanced Dual-Stream Network for Video Anomaly Detection

Unsupervised Spatio-Temporal State Estimation for Fine-grained Adaptive Anomaly Diagnosis of Industrial Cyber-physical Systems

Abnormal Traffic Detection System Based on Feature Fusion and Sparse Transformer

Multivariate Time Series Anomaly Detection with Fourier Time Series Transformer

Dynamic Deep Graph Convolution with Enhanced Transformer Networks for Time Series Anomaly Detection in IoT

A two-stage adversarial Transformer based approach for multivariate industrial time series anomaly detection

Anomaly Detection for Asynchronous Multivariate Time Series of Nuclear Power Plants Using a Temporal-Spatial Transformer

Reconstruction-based Multi-Scale Anomaly Detection for Cyber-Physical Systems

Self-Attention-Based Multivariate Anomaly Detection for CPS Time Series Data with Adversarial Autoencoders

Improved LSTM-based Time-Series Anomaly Detection in Rail Transit Operation Environments

An Interpretable Multivariate Time-series Anomaly Detection Method in Cyber-Physical Systems Based on Adaptive Mask

Adversarial Training of LSTM-ED Based Anomaly Detection for Complex Time-Series in Cyber-Physical-social Systems

TransNAS-TSAD: harnessing transformers for multi-objective neural architecture search in time series anomaly detection