Abstract:Cyber–physical systems (CPSs) serve as the pivotal core of Internet of Things (IoT) infrastructures, such as smart grids and intelligent transportation, deploying interconnected sensing devices to monitor operating status. With increasing decentralization, the surge in sensor devices expands the potential vulnerability to cyber attacks. It is imperative to conduct anomaly detection research on the multivariate time series data that these sensors produce to bolster the security of distributed CPSs. However, the high dimensionality, absence of anomaly labels in real-world datasets, and intricate non-linear relationships among sensors present considerable challenges in formulating effective anomaly detection algorithms. Recent deep-learning methods have achieved progress in the field of anomaly detection. Yet, many methods either rely on statistical models that struggle to capture non-linear relationships or use conventional deep learning models like CNN and LSTM, which do not explicitly learn inter-variable correlations. In this study, we propose a novel unsupervised anomaly detection method that integrates Sparse Autoencoder with Graph Transformer network (SGTrans). SGTrans leverages Sparse Autoencoder for the dimensionality reduction and reconstruction of high-dimensional time series, thus extracting meaningful hidden representations. Then, the multivariate time series are mapped into a graph structure. We introduce a multi-head attention mechanism from Transformer into graph structure learning, constructing a Graph Transformer network forecasting module. This module performs attentive information propagation between long-distance sensor nodes and explicitly models the complex temporal dependencies among them to enhance the prediction of future behaviors. Extensive experiments and evaluations on three publicly available real-world datasets demonstrate the effectiveness of our approach.

An Asymmetrical Graph Siamese Network for One-classAnomaly Detection of Engine Equipment with Multi-source Fusion

Data anomaly detection for structural health monitoring using a combination network of GANomaly and CNN

A Graph Embedded In Graph Framework With Dual-sequence Input For Efficient Anomaly Detection of Complex Equipment Under Insufficient Samples

Full Graph Autoencoder for One-Class Group Anomaly Detection of IIoT System

Unsupervised Multimodal Anomaly Detection With Missing Sources for Liquid Rocket Engine

Anomaly Detection for Data from Unmanned Systems via Improved Graph Neural Networks with Attention Mechanism

Memory-augmented Skip-Connected Autoencoder for Unsupervised Anomaly Detection of Rocket Engines with Multi-Source Fusion.

A novel anomaly detection method for multimodal WSN data flow via a dynamic graph neural network

Accurate Anomaly Detection Leveraging Knowledge-enhanced GAT

Integrating Sensor Embeddings with Variant Transformer Graph Networks for Enhanced Anomaly Detection in Multi-Source Data

Multisensor Anomaly Detection and Interpretable Analysis for Linear Induction Motors

An Unsupervised Spatiotemporal Fusion Network Augmented with Random Mask and Time-Relative Information Modulation for Anomaly Detection of Machines with Multiple Measuring Points.

AddAG-AE: Anomaly Detection in Dynamic Attributed Graph Based on Graph Attention Network and LSTM Autoencoder

Self-Supervised Variational Graph Autoencoder for System-Level Anomaly Detection

SLSG: Industrial Image Anomaly Detection by Learning Better Feature Embeddings and One-Class Classification

Virtual sensor-based imputed graph attention network for anomaly detection of equipment with incomplete data

CSiamese: a Novel Semi-Supervised Anomaly Detection Framework for Gas Turbines Via Reconstruction Similarity

Graph Transformer Network Incorporating Sparse Representation for Multivariate Time Series Anomaly Detection

ASGNet: Adaptive Semantic Gate Networks for Log-Based Anomaly Diagnosis

Complex system anomaly detection via learnable temporal-spatial graph with degradation tendency segmentation

Attention-aware temporal-spatial graph neural network with multi-sensor information fusion for fault diagnosis