Abstract:Data-defect would affect the data quality and the analysis results of data mining. This paper presents a data-defect inspection method with kernel-neighbor-density-change outlier factor (KNDCOF). The definition of kernel neighbor density is proposed to represent the density of each object in database, and the ascending distance series (ADS) of each object is calculated based on the kernel distance between the object and its neighbors. Then, the average density fluctuation (ADF) of the object is established according to the weighted sum of the square of density difference between the object and others in ADS. Finally, the KNDCOF of the object is equal to the ratios of the ADF of the object and the average ADF of neighbors of the object. The degree of the object being an outlier is indicated by the KNDCOF value. The experiments are performed on three real data sets to evaluate the effectiveness of the proposed method. The experimental results verify that the proposed method has higher quality of data-defect inspection and does not increase the time complexity. Note to Practitioners-Data-defect inspection is an important procedure of data preprocessing for a real industrial process. This paper presents a data-defect inspection method with kernel-neighbor-density-change outlier factor to identify the outliers, and addresses the challenges associated with the strong correlation and the nonlinearity of the industrial data. The proposed method calculates the outlier factor for each object, which quantifies how outlying it is. The outlier factor is based on the density difference between the object and its neighbors. The larger the outlier factor of an object is, the higher the outlierness of the object is. The proposed method could be wildly used in an industrial complex data set with different density regions. In the industrial field, engineers can deal with the objects with high outlier factor values based on the actual requirements.

DWOF: A Robust Density-Based Outlier Detection Approach

A neighborhood weighted-based method for the detection of outliers

A double-weighted outlier detection algorithm considering the neighborhood orientation distribution of data objects

SDROF: outlier detection algorithm based on relative skewness density ratio outlier factor

Enhancing Effectiveness of Density-Based Outlier Mining

Robust Subspace Outlier Detection in High Dimensional Space

A New Outlier Detection Algorithm Based on Fast Density Peak Clustering Outlier Factor

NDOD: an Efficient Neighboring Dependent Outlier Detector for Bias Distributed Large Datasets

Outlier detection method based on high-density iteration

Improved approaches for density-based outlier detection in wireless sensor networks

A Local Density-Based Approach for Local Outlier Detection

D3O: A Framework for Distributed Distance-based Detection of Outliers in Large Data Sets

A Parametric and Non-Parametric Approach for High-Accurate Outlier Detection.

Outlier detection using distributionally robust optimization under the Wasserstein metric

Dimensionality-Aware Outlier Detection: Theoretical and Experimental Analysis

A Novel Outlier Detection Method for Multivariate Data

RODD: Robust Outlier Detection in Data Cubes

Data-Defect Inspection with Kernel-Neighbor-Density-Change Outlier Factor.

A Distributionally Robust Optimization Approach for Outlier Detection *

A robust distance-based approach for detecting multidimensional outliers

A Improved Clustering and Outlier Detection Algorithm