Abstract:Data-defect would affect the data quality and the analysis results of data mining. This paper presents a data-defect inspection method with kernel-neighbor-density-change outlier factor (KNDCOF). The definition of kernel neighbor density is proposed to represent the density of each object in database, and the ascending distance series (ADS) of each object is calculated based on the kernel distance between the object and its neighbors. Then, the average density fluctuation (ADF) of the object is established according to the weighted sum of the square of density difference between the object and others in ADS. Finally, the KNDCOF of the object is equal to the ratios of the ADF of the object and the average ADF of neighbors of the object. The degree of the object being an outlier is indicated by the KNDCOF value. The experiments are performed on three real data sets to evaluate the effectiveness of the proposed method. The experimental results verify that the proposed method has higher quality of data-defect inspection and does not increase the time complexity. Note to Practitioners-Data-defect inspection is an important procedure of data preprocessing for a real industrial process. This paper presents a data-defect inspection method with kernel-neighbor-density-change outlier factor to identify the outliers, and addresses the challenges associated with the strong correlation and the nonlinearity of the industrial data. The proposed method calculates the outlier factor for each object, which quantifies how outlying it is. The outlier factor is based on the density difference between the object and its neighbors. The larger the outlier factor of an object is, the higher the outlierness of the object is. The proposed method could be wildly used in an industrial complex data set with different density regions. In the industrial field, engineers can deal with the objects with high outlier factor values based on the actual requirements.

Robust Outlier Detection Algorithm Based on k-Nearest Neighbor Region Center Migration

Discovery of Regional Co-location Patterns with k-Nearest Neighbor Graph.

A k-Nearest Neighbor Medoid-Based Outlier Detection Algorithm

Outlier detection algorithm based on k-nearest neighbors-local outlier factor

A Centroid-Based Outlier Detection Method

A neighborhood weighted-based method for the detection of outliers

Outlier Detecting Algorithm Based on Clustering and Local Information

K -means Algorithm Based on Outliers Detection

Robust Local Outlier Detection

Robust Multi-Kernel Nearest Neighborhood for Outlier Detection

Robust localization against outliers in wireless sensor networks

Data-Defect Inspection with Kernel-Neighbor-Density-Change Outlier Factor.

A New Outlier Detection Algorithm Based on Fast Density Peak Clustering Outlier Factor

Local Outlier Coefficient-Based Clustering Algorithm

Outlier detection based on k-neighborhood MST

Robust Outlier Detection Method Based on Local Entropy and Global Density

SDROF: outlier detection algorithm based on relative skewness density ratio outlier factor

A Novel Outlier Cluster Detection Algorithm Without Top-N Parameter

OUTLIER DETECTION BY WEIGHTED MERCER-KERNEL BASED FUZZY CLUSTERING ALGORITHM

Efficient Outlier Detection for High-Dimensional Data

Square Symmetric Neighborhood Based Local Outlier Detection Algorithm