Abstract:Anomaly detection aims at finding anomalies deviating from the normal data patterns. Virtually all anomaly detection methods create a model of the normal patterns before finding anomalies. In high-dimensional scenarios, due to the curse of dimensionality, it is difficult to construct the model of normal patterns in the full dimensional space. Subspace methods assuming that data can be characterized by low-dimensional manifolds have attracted a great deal of research. However, in unsupervised setting, unlabeled data is composed of both the normal and the abnormal data. The existence of anomalies might affect the establishment of the underlying normal subspaces. The undetermined number of the underlying subspaces also brings difficulties in subspace selection. To tackle the aforementioned problems, we come up with a weighted subspace anomaly detection (WSAD) method. We utilize correntropy to construct an objective function to mitigate the influence of the anomalies, which can be regarded as a weighting method for different data. Besides, we introduce an auxiliary variable with block sparsity regularization to achieve adaptive subspace selection, which can be regarded as a weighting method for different subspaces. After the normal underlying subspaces being established, we define the outlier scores by considering the deviation from the underlying subspaces, the local outlier score within subspaces, and the subspace scale. We use the half-quadratic theory to transform the optimization problem defined in WSAD, and apply alternating optimization to solve the transformed problem. Theoretically, we prove the convergence of the optimization algorithm. Experimentally, we demonstrate the effectiveness of the proposed method on both synthetic data and real datasets.

Abnormal Tcmp Detection Algorithm Based On Sparse Pattern

Adaptive Cutoff Distance Based Density Peak Pivot for Metric Space Outlier Detection

A Genetic Algorithm Based Technique for Outlier Detection with Fast Convergence.

Anomaly detection algorithm based on FrFT transform and total variation regularization

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

An ADMM Approach for Constructing Abnormal Subspace of Sparse PCA

Effective algorithm for maximal pattern-based subspace clustering

Anomaly Detection Algorithm Based on CFSFDP

CTF: Anomaly Detection in High-Dimensional Time Series with Coarse-to-Fine Model Transfer

A fast MST-inspired kNN-based outlier detection method

Outlier Detection with Cluster Catch Digraphs

A fuzzy detection approach to high-dimensional anomalies

SHARP OPTIMALITY FOR HIGH-DIMENSIONAL COVARIANCE TESTING UNDER SPARSE SIGNALS

Boost sparse coding based abnormal event detection via explicitly applying temporal continuity constraint

A New Outlier Detection Algorithm Based on Fast Density Peak Clustering Outlier Factor

Weighted subspace anomaly detection in high-dimensional space

A Novel Tensor Algebraic Approach for High-Dimensional Outlier Detection under Data Misalignment

Compressed Smooth Sparse Decomposition

CDF Transform-and-Shift: an Effective Way to Deal with Datasets of Inhomogeneous Cluster Densities

Anomaly Detection Via Local Coordinate Factorization And Spatio-Temporal Pyramid

Detecting Abnormal Events Via Hierarchical Dirichlet Processes.