Abstract:Data-defect would affect the data quality and the analysis results of data mining. This paper presents a data-defect inspection method with kernel-neighbor-density-change outlier factor (KNDCOF). The definition of kernel neighbor density is proposed to represent the density of each object in database, and the ascending distance series (ADS) of each object is calculated based on the kernel distance between the object and its neighbors. Then, the average density fluctuation (ADF) of the object is established according to the weighted sum of the square of density difference between the object and others in ADS. Finally, the KNDCOF of the object is equal to the ratios of the ADF of the object and the average ADF of neighbors of the object. The degree of the object being an outlier is indicated by the KNDCOF value. The experiments are performed on three real data sets to evaluate the effectiveness of the proposed method. The experimental results verify that the proposed method has higher quality of data-defect inspection and does not increase the time complexity. Note to Practitioners-Data-defect inspection is an important procedure of data preprocessing for a real industrial process. This paper presents a data-defect inspection method with kernel-neighbor-density-change outlier factor to identify the outliers, and addresses the challenges associated with the strong correlation and the nonlinearity of the industrial data. The proposed method calculates the outlier factor for each object, which quantifies how outlying it is. The outlier factor is based on the density difference between the object and its neighbors. The larger the outlier factor of an object is, the higher the outlierness of the object is. The proposed method could be wildly used in an industrial complex data set with different density regions. In the industrial field, engineers can deal with the objects with high outlier factor values based on the actual requirements.

How to detect outliers in data envelopment analysis by Kourosh and Arash method

A Modified Outlier Detection Method in Dynamic Data Reconciliation

A Predictive DEA Model for Outlier Detection

Uncertain Data Envelopment Analysis: Box Uncertainty

A review of inverse data envelopment analysis: origins, development, and future directions

Data-Defect Inspection with Kernel-Neighbor-Density-Change Outlier Factor.

Alternative Secondary Goals in Multiplicative Two-Stage Data Envelopment Analysis

Robust two-stage DEA models under discrete uncertain data

A Parametric and Non-Parametric Approach for High-Accurate Outlier Detection.

A note on efficiency decomposition in two-stage data envelopment analysis

An application procedure for DEA

Sensitivity and Stability Analysis in DEA with Bounded Uncertainty.

A new robust DEA model and super-efficiency measure

An Alternative method in Multi-Attribute Decision Making using Data Envelopment Analysis and Fuzzy concept

Uncertain Data Envelopment Analysis with Imprecisely Observed Inputs and Outputs

Efficiency Evaluation Based on Data Envelopment Analysis in the Big Data Context.

An inverse optimization model for imprecise data envelopment analysis

Additive integer-valued data envelopment analysis with missing data: A multi-criteria evaluation approach

Statistical Tests Based on DEA Efficiency Scores

Efficiency Evaluation of Banks with Many Branches using a Heuristic Framework and Dynamic Data Envelopment Optimization Approach: A Real Case Study

Dealing with Missing Data Based on Data Envelopment Analysis and Halo Effect