Abstract:Outlier detection is of vital importance in data mining tasks, with numerous applications, including video surveillance and credit card fraud detection. Quite a few outlier detection algorithms have been developed and have received considerable attention, and most existing methods are classified as distance-based algorithms and density-based algorithms. However, both of these approaches have some flaws. The former has difficulty detecting local outliers, and the latter cannot handle low-density pattern problems. Moreover, outlier detection algorithms are sensitive to parameter settings. This paper proposes a simple and efficient outlier detection approach (called ADD) based on the average divergence difference of data objects; in this method there is no need to artificially define the number of neighbors of objects k to solve the above issues. In this algorithm, two new measures, called the divergence factor (DF) and the average divergence difference (LADD), are developed based on the skewed distribution characteristics of data objects and their natural neighbors, thus improving the accuracy of local outlier detection from an innovative research perspective. These factors are presented as external and internal characterization factors because the former characterizes the skew distribution characteristics and compactness relationship of data objects and the latter represents the difference in the skew distribution characteristics of data objects in a neighborhood. Then, we set an appropriate threshold to distinguish whether a data point is an outlier, which eliminates the interference of the Top-N problem. Finally, the final experimental results show that the ADD algorithm achieves an overall improvement in local outlier detection, especially in the detection of outliers in some datasets with complex distributions and in low-density areas, compared to that achieved by state-of-the-art algorithms.

Algorithm for Outlier Detection in Large Dataset Based on Weighted KNN

A neighborhood weighted-based method for the detection of outliers

Outlier Detection Algorithm Based on Reachable Neighbor

A fast MST-inspired kNN-based outlier detection method

A double-weighted outlier detection algorithm considering the neighborhood orientation distribution of data objects

Outlier detection algorithm based on k-nearest neighbors-local outlier factor

Robust Iterative Algorithm of Weighted Least Squares Support Vector Machine and Its Application in Spectral Analysis

WeightLOFCC: A Heuristic Weight-Setting Strategy of LOF Applied to Outlier Detection in Time Series Data

Anomaly Detection in Wireless Sensor Networks Based on KNN

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

An Outlier Detection Method Based On Symmetry and Curvature Threshold

NDOD: an Efficient Neighboring Dependent Outlier Detector for Bias Distributed Large Datasets

Robust Multi-Kernel Nearest Neighborhood for Outlier Detection

A New Outlier Detection Algorithm Based on Fast Density Peak Clustering Outlier Factor

A New Algorithm for Large-Scale Geographically Weighted Regression with K-Nearest Neighbors

Outlier Detection of GPS Monitoring Data Using Relational Analysis and Negative Selection Algorithm

Optimal Weighted K-nearest Neighbour Algorithm for Wireless Sensor Network Fingerprint Localisation in Noisy Environment.

Detecting outliers by clustering algorithms

ADD: a new average divergence difference-based outlier detection method with skewed distribution of data objects

Outlier detection method based on high-density iteration

Intelligent Identification and Order-Sensitive Correction Method of Outliers from Multi-Data Source Based on Historical Data Mining