Abstract:Abstract Data distribution presents sparsity in a high-dimensional space, thus difficulty affording sufficient information to distinguish anomalies from normal instances. Moreover, a high-dimensional space may exist many subspaces, obviously, anomalies can exist in any subspaces. This also creates trouble for anomaly mining. Consequently, it is a challenge for anomaly mining in a high-dimensional space. To address this, here proposed a deep hypersphere method fused with probabilistic approach for anomaly mining. In the proposed method, the deep neural network is used as a feature extractor to capture those layered low-dimensional features from the data lying in a high-dimensional space. To promote the ability of the deep neural network to capture these features, the probability approach of sample binary-classification is fused into the loss function, thereby forming the probability deep neural network Then, the hypersphere is used as an anomalous detector. In the low-dimensional features extracted by the deep neural network, the anomalous detector separates anomaly features from normal features. Finally, experimental results on synthetic and real-world data sets show that the proposed method not only outperforms the state-of-the-art methods in the precision of mined anomalies, but also this hybrid method consisting of deep neural networks and traditional detection methods has outstanding capabilities of mining high-dimensional anomalies. We find that deep neural networks fusing the probabilistic method of sample multi-classification can capture these desired low-dimensional features; moreover, these captured low-dimensional features present more obvious layered characteristics. We also demonstrate that as long as these captured features represent a fewer anomaly instances, it can sufficiently identify anomalies from normal instances.

Deep Orthogonal Hypersphere Compression for Anomaly Detection

Deep Low-Rank Prior for Hyperspectral Anomaly Detection

Anomaly detection for high-dimensional space using deep hypersphere fused with probability approach

A fuzzy detection approach to high-dimensional anomalies

From anomaly detection to open set recognition: Bridging the gap

Hyperspectral Anomaly Detection by Data Sphering and Sparsity Density Peaks

Spectral-Spatial Deep Support Vector Data Description for Hyperspectral Anomaly Detection

A Fast Low Rank Approximation and Sparsity Representation Approach to Hyperspectral Anomaly Detection

Exploiting the Sparse Characteristics in Probabilistic Feature Space for Hyperspectral Anomaly Detection

Exploring the Intrinsic Probability Distribution for Hyperspectral Anomaly Detection

Hyperspectral Anomaly Detection with Data Sphering and Unsupervised Target Detection.

Hyperspectral deep convolution anomaly detection based on weight adjustment strategy

Iterative Graph Propagation for Hyperspectral Anomaly Detection

Hyperbolic Space-Based Autoencoder for Hyperspectral Anomaly Detection

Graph and Sparsity Regularized Decomposition Model for Hyperspectral Anomaly Detection

Hyperspectral Anomaly Detection Based on Adaptive Low-Rank Transformed Tensor

Application of low-dimension hyper-plane in anomaly detection of hyperspectral image

Provably Convergent Plug-and-play Proximal Block Coordinate Descent Method for Hyperspectral Anomaly Detection

Hyperspectral Anomaly Detection Via Low-Rank Decomposition and Morphological Filtering

Kernel-Based Decomposition Model with Total Variation and Sparsity Regularizations Via Union Dictionary for Nonlinear Hyperspectral Anomaly Detection.

Collaborative Representation for Hyperspectral Anomaly Detection