Abstract:Local outlier factor (LOF) effectively addresses the problem of outlier detection in skewed datasets, which has been shown remarkable detection performance in variety of applications. In this paper, we propose an efficient Top-n local outlier detection algorithm, called MTLOF (Multi-granularity upper bound pruning based top-n LOF detection), for fast detecting top-n local outliers in large-scale datasets. First, we propose four LOF upper bounds that are closer to the real LOF value to avoid the computations of LOF values, and analyze their computational complexity theoretically. Second, by combining with index structure and the upper bounds UB1 and UB2, we propose a two-layer Cell pruning strategy, not only adopting the global Cell pruning strategy, but also introducing a local pruning strategy based on the internal data objects of Cells, which effectively prunes the high-density regions. Third, we propose two more reasonable and effective data object pruning strategies using the proposed upper bounds UB3 and UB4. UB3 and UB4 are closer to the real LOF value, which benefits to pruning more data objects. On the other hand, the upper bound calculation method based on computation reuse greatly reduces the computational cost. Finally, we optimize the selecting method of initial Top-n local outliers leveraging the established index structure. Specifically, we select the initial Top-n local outliers in sparse regions, which is conducive to selecting the data objects with a larger LOF value as the initial local outliers. Experimental study on six real-world datasets demonstrates the efficiency and scalability of our proposed MTLOF— up to 3.5 times faster than the state-of-the-art TOLF (Top-n LOF) method.

A Fast Algorithm for Density-based Top-n Local Outlier Detection

MLOD: Multi-granularity Local Outlier Detection.

Outlier Detection Algorithm Based on Reachable Neighbor

CELOF: Effective and fast memory efficient local outlier detection in high-dimensional data streams

Outlier detection algorithm based on k-nearest neighbors-local outlier factor

A neighborhood weighted-based method for the detection of outliers

IncLOF:An Incremental Algorithm for Mining Local Outliers in Dynamic Environment

WeightLOFCC: A Heuristic Weight-Setting Strategy of LOF Applied to Outlier Detection in Time Series Data

LDBOD: A novel local distribution based outlier detector

A New Outlier Detection Algorithm Based on Fast Density Peak Clustering Outlier Factor

Out-of-core Outlier Removal for Large-Scale Indoor Point Clouds

Automatic Hyperparameter Tuning Method for Local Outlier Factor, with Applications to Anomaly Detection

ELOF: fast and memory-efficient anomaly detection algorithm in data streams

A Local Density-Based Approach for Local Outlier Detection

A fast MST-inspired kNN-based outlier detection method

A Review of Local Outlier Factor Algorithms for Outlier Detection in Big Data Streams

A Self-Representation Method with Local Similarity Preserving for Fast Multi-View Outlier Detection

Comparative Study of Neighbor-based Methods for Local Outlier Detection

A Fast Density Peak Clustering Method for Power Data Security Detection Based on Local Outlier Factors

DWOF: A Robust Density-Based Outlier Detection Approach

Ordinal Outlier Detection Based On Recursive Uniform Partitioning