Abstract:Outlier detection is critically important in the field of data mining. Real-world data have the impreciseness and ambiguity which can be handled by means of rough set theory. Information entropy is an effective way to measure the uncertainty in an information system. Most outlier detection methods may be called unsupervised outlier detection because they are only dealt with unlabeled data. When sufficient labeled data are available, these methods are used in a decision information system, which means that the decision attribute is discarded. Thus, these methods maybe not right for outlier detection in a a decision information system. This paper proposes supervised outlier detection using conditional information entropy and rough set theory. Firstly, conditional information entropy in a decision information system based on rough set theory is calculated, which provides a more comprehensive measure of uncertainty. Then, the relative entropy and relative cardinality are put forward. Next, the degree of outlierness and weight function are presented to find outlier factors. Finally, a conditional information entropy-based outlier detection algorithm is given. The performance of the given algorithm is evaluated and compared with the existing outlier detection algorithms such as LOF, KNN, Forest, SVM, IE, and ECOD. Twelve data sets have been taken from UCI to prove its efficiency and performance. For example, the AUC value of CIE algorithm in the Hayes data set is 0.949, and the AUC values of LOF, KNN, SVM, Forest, IE and ECOD algorithms in the Hayes data set are 0.647, 0.572, 0.680, 0.676, 0.928 and 0.667, respectively. The advantage of the proposed outlier detection method is that it fully utilizes the decision information.

Outlier Detection Algorithm Based on Approximate Outlier Factor

An Outlier Mining Algorithm Based on Approximate Outlier Factor

Outlier Detection Algorithm Based on Reachable Neighbor

A Clustering Iterative Detection Algorithm Based on Outlier

An Improved Efficient Algorithm for Detecting Outliers

A New Outlier Detection Algorithm Based on Fast Density Peak Clustering Outlier Factor

An Outlier Fuzzy Detection Method Using Fuzzy Set Theory

A New Outlier Detection Method Based on Machine Learning

A Novel Outlier Cluster Detection Algorithm Without Top-N Parameter

Fairness-aware Outlier Ensemble

A Kind of Outlier Detection Algorithm Based on Similarity Measurement

Outlier Detecting Algorithm Based on Clustering and Local Information

SDROF: outlier detection algorithm based on relative skewness density ratio outlier factor

Automatic K-Means Clustering Algorithm for Outlier Detection

Detecting outliers by clustering algorithms

Improved Outlier Detection Algorithm Based on Difference Between Nearest Neighbors Distance

Double-Clustering based outlier detection algorithm for large datasets

Outlier detection based on genetic algorithm for clustering

OUTLIER DETECTION BY WEIGHTED MERCER-KERNEL BASED FUZZY CLUSTERING ALGORITHM

Outlier detection using conditional information entropy and rough set theory

Efficient Outlier Detection for High-Dimensional Data