Abstract:In conventional outlier detection, global outliers are easily identified, but the efficacy diminishes when faced with local outliers within clusters of varying densities. Conversely, while the local outlier factor excels in detecting local anomalies, its performance falters as the number of outliers increases. To address these limitations and cater to intricate datasets by ensuring adept detection of both global and local outliers, this paper introduces a novel outlier detection approach known as High-Density Iteration (HDIOD). The methodology begins by leveraging a combination of the Gaussian kernel function and k -nearest neighbors to compute the local kernel density for each sample. Subsequently, the process involves comparing the local kernel density of a given sample with that of its k -neighbors. If the sample's local kernel density is lower than the maximum density among its neighbors, it selects the neighbor with the highest local kernel density within its k -neighbors as the new object for comparison. This iterative process continues, where the set of k -neighbors for all objects constitutes the extended k -neighbors of the original sample. The final step involves utilizing the ratio of the maximum local kernel density within the extended k -nearest neighbors to the local density of the sample as a measure of the sample's outlier degree. Experimental evaluations conducted on 12 synthetic datasets and 19 real-world datasets demonstrate the effectiveness of the HDIOD method. Comparative analyses with 13 commonly used outlier detection methods underscore the high detection accuracy and robustness of HDIOD to parameter variations.

An Outlier Detection Algorithm Based on a Soft Hyper-Sphere for High Dimension Nonlin-Ear Data

Outliers detection algorithm based on nonlinear data transformation

Outlier Detection Using Local Density and Global Structure

Varying-scale HCA-DBSCAN-based anomaly detection method for multi-dimensional energy data in steel industry

Efficient Outlier Detection for High-Dimensional Data

An Outlier Detection Algorithm Based on Cross-Correlation Analysis for Time Series Dataset

A neighborhood weighted-based method for the detection of outliers

Robust Sparse Gaussian Process Regression for Soft Sensing in Industrial Big Data Under the Outlier Condition

Outliers Detection Based on Kernel Function-Principle Component Dimension Reduction

An Angle-Based Subspace Anomaly Detection Approach to High-Dimensional Data: with an Application to Industrial Fault Detection.

An Improved Outlier Detection Method in High-dimension Based on Weighted Hypergraph

A Spectral Clustering Based Outlier Detection Technique.

Outlier Detection Based on Eigenspace Subtracting

Projected outlier detection in high-dimensional mixed-attributes data set

HOT: Hypergraph-Based Outlier Test for Categorical Data.

Outlier detection method based on high-density iteration

Detecting Outliers for Complex Nonlinear Systems with Dynamic Ensemble Learning

Outlier Detection Using Structural Scores in a High-Dimensional Space.

Onion-Peeling Outlier Detection in 2-D data Sets

A geometric framework for outlier detection in high-dimensional data

New Local Density Definition Based on Minimum Hyper Sphere for Outlier Mining Algorithm Using in Industrial Databases