Abstract:Cyber–physical systems (CPSs) serve as the pivotal core of Internet of Things (IoT) infrastructures, such as smart grids and intelligent transportation, deploying interconnected sensing devices to monitor operating status. With increasing decentralization, the surge in sensor devices expands the potential vulnerability to cyber attacks. It is imperative to conduct anomaly detection research on the multivariate time series data that these sensors produce to bolster the security of distributed CPSs. However, the high dimensionality, absence of anomaly labels in real-world datasets, and intricate non-linear relationships among sensors present considerable challenges in formulating effective anomaly detection algorithms. Recent deep-learning methods have achieved progress in the field of anomaly detection. Yet, many methods either rely on statistical models that struggle to capture non-linear relationships or use conventional deep learning models like CNN and LSTM, which do not explicitly learn inter-variable correlations. In this study, we propose a novel unsupervised anomaly detection method that integrates Sparse Autoencoder with Graph Transformer network (SGTrans). SGTrans leverages Sparse Autoencoder for the dimensionality reduction and reconstruction of high-dimensional time series, thus extracting meaningful hidden representations. Then, the multivariate time series are mapped into a graph structure. We introduce a multi-head attention mechanism from Transformer into graph structure learning, constructing a Graph Transformer network forecasting module. This module performs attentive information propagation between long-distance sensor nodes and explicitly models the complex temporal dependencies among them to enhance the prediction of future behaviors. Extensive experiments and evaluations on three publicly available real-world datasets demonstrate the effectiveness of our approach.

GraphSensor: A Graph Attention Network for Time-Series Sensor

Attention-based Temporal Graph Representation Learning for EEG-based Emotion Recognition

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

A Multi-Head Pseudo Nodes Based Spatial–temporal Graph Convolutional Network for Emotion Perception from GAIT

Time-Attention Graph Convolutional Network Soft Sensor in Biochemical Processes

SensorNet: An Adaptive Attention Convolutional Neural Network for Sensor Feature Learning

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Spatial-Temporal Data Inference With Graph Attention Neural Networks in Sparse Mobile Crowdsensing

Graph Attention Network with Focal Loss for Seizure Detection on Electroencephalography Signals

A Spatiotemporal Graph Attention Network Based on Synchronization for Epileptic Seizure Prediction

Graph Transformer Network Incorporating Sparse Representation for Multivariate Time Series Anomaly Detection

Time2Graph+: Bridging Time Series and Graph Representation Learning via Multiple Attentions

EEG-GCN: Spatio-Temporal and Self-Adaptive Graph Convolutional Networks for Single and Multi-View EEG-Based Emotion Recognition

Modeling Multivariate Biosignals With Graph Neural Networks and Structured State Space Models

Graph Neural Network-Based Anomaly Detection in Multivariate Time Series

Graph attention U-Net to fuse multi-sensor signals for long-tailed distribution fault diagnosis

Attention-aware temporal-spatial graph neural network with multi-sensor information fusion for fault diagnosis

Exploring non-Euclidean relationships in EEG emotion recognition: A dynamic graph attention network

STGATE: Spatial-temporal graph attention network with a transformer encoder for EEG-based emotion recognition

STGSN — A Spatial–Temporal Graph Neural Network framework for time-evolving social networks

MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition