Abstract:Outlier detection is of vital importance in data mining tasks, with numerous applications, including video surveillance and credit card fraud detection. Quite a few outlier detection algorithms have been developed and have received considerable attention, and most existing methods are classified as distance-based algorithms and density-based algorithms. However, both of these approaches have some flaws. The former has difficulty detecting local outliers, and the latter cannot handle low-density pattern problems. Moreover, outlier detection algorithms are sensitive to parameter settings. This paper proposes a simple and efficient outlier detection approach (called ADD) based on the average divergence difference of data objects; in this method there is no need to artificially define the number of neighbors of objects k to solve the above issues. In this algorithm, two new measures, called the divergence factor (DF) and the average divergence difference (LADD), are developed based on the skewed distribution characteristics of data objects and their natural neighbors, thus improving the accuracy of local outlier detection from an innovative research perspective. These factors are presented as external and internal characterization factors because the former characterizes the skew distribution characteristics and compactness relationship of data objects and the latter represents the difference in the skew distribution characteristics of data objects in a neighborhood. Then, we set an appropriate threshold to distinguish whether a data point is an outlier, which eliminates the interference of the Top-N problem. Finally, the final experimental results show that the ADD algorithm achieves an overall improvement in local outlier detection, especially in the detection of outliers in some datasets with complex distributions and in low-density areas, compared to that achieved by state-of-the-art algorithms.

M-DBSCAN: Modified DBSCAN Clustering Algorithm for Detecting and Controlling Outliers

AutoSCAN: automatic detection of DBSCAN parameters and efficient clustering of data in overlapping density regions

Unsupervised Parameter-free Outlier Detection using HDBSCAN* Outlier Profiles

Improved Method for Noise Detection by DBSCAN and Angle Based Outlier Factor in High Dimensional Datasets

Cluster-Based Outlier Detection

A Statistical Information-Based Clustering Approach in Distance Space

AMD-DBSCAN: An Adaptive Multi-density DBSCAN for datasets of extremely variable density

Towards Metric DBSCAN: Exact, Approximate, and Streaming Algorithms

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Using Greedy Algorithm: DBSCAN Revisited II

On Saving Outliers for Better Clustering over Noisy Data.

Detecting outliers by clustering algorithms

A New Outlier Detection Method Considering Outliers As Model Errors

MDBSCAN: A multi-density DBSCAN based on relative density

Outlier Detection with Cluster Catch Digraphs

Data-driven cluster analysis method: a novel outliers detection method in multivariate data

ADD: a new average divergence difference-based outlier detection method with skewed distribution of data objects

A Method of Two-Stage Clustering Learning Based on Improved DBSCAN and Density Peak Algorithm

D.MCA: Outlier Detection with Explicit Micro-Cluster Assignments

MS2OD: Outlier Detection Using Minimum Spanning Tree and Medoid Selection

An efficient DBSCAN optimized by arithmetic optimization algorithm with opposition-based learning