Abstract:Network traffic anomaly detection is critical for advanced network applications. However, network traffic monitoring data arrive in a streaming fashion and could be infinite, which makes the offline algorithms that attempt to store the entire stream monitoring data for analysis not scalable. To well utilize the strong ability of tensor model, we use a tensor to represent the prior non-anomalous traffic matrices and propose a novel unsupervised anomaly detection framework that can be used to detect anomalies in a streaming fashion by making only one pass over the data while utilizing limited storage. In the framework, we propose a succinct tensor sketch to maintain, in a streaming model, the subspace that can well represent all prior non-anomalous data detected. Using the subspace, anomalies in each new incoming traffic monitoring data can be quickly detected based on a simple outlier score calculation. Further, we prove that the tensor sketch is mergeable. Exploiting this property, we propose a distributed anomaly detection framework in which the distributed node only needs to upload its succinct tensor sketch instead of the raw monitoring data to the central node to calculate the global subspace of the whole network, which greatly saves the transmission cost. We theoretically prove that our tensor sketch based anomaly detection algorithm compares favorably with the offline approach which calculates the subspace based on expensive global Singular Value Decomposition (SVD). The experimental results demonstrate the effectiveness and efficiency of our approach over other popular online anomaly detection algorithms.

Anomaly Detection with Tensor Networks

Anomaly Detection from a Tensor Train Perspective

Anomaly Detection in Spatiotemporal Data Via Regularized Non-Negative Tensor Analysis

Enhanced Tensor Low-Rank Representation Learning for Hyperspectral Anomaly Detection

Tensor Factorization for Accurate Anomaly Detection in Dynamic Networks

Anomaly Detection using One-Class Neural Networks

Anomaly Detection Via Tensor Multisubspace Learning and Nonconvex Low-Rank Regularization

Anomaly Detection in Road Networks Using Sliding-Window Tensor Factorization

TFD-Net: Transformer Deviation Network for Weakly Supervised Anomaly Detection

On-Line Network Traffic Anomaly Detection Based on Tensor Sketch

Graph Based Tensor Recovery for Accurate Internet Anomaly Detection

A Novel Sequence Tensor Recovery Algorithm for Quick and Accurate Anomaly Detection

DTAAD: Dual Tcn-Attention Networks for Anomaly Detection in Multivariate Time Series Data

Hyperspectral Anomaly Detection Based on Adaptive Low-Rank Transformed Tensor

Hybrid Graph Transformer Networks for Multivariate Time Series Anomaly Detection

A Novel Multi-Modal Incremental Tensor Decomposition for Anomaly Detection in Large-Scale Networks

Robust Tensor Subspace Learning for Anomaly Detection.

Anomaly Detection by One Class Latent Regularized Networks

Optimal Classification-based Anomaly Detection with Neural Networks: Theory and Practice

Low-rank on Graphs plus Temporally Smooth Sparse Decomposition for Anomaly Detection in Spatiotemporal Data