Abstract:Many real applications such as businesses and health generate large categorical datasets with uncertainty. A fundamental task is to efficiently discover hidden and non-trivial patterns from such large uncertain categorical datasets. Since the exact value of an attribute is often unknown in uncertain categorical datasets, conventional clustering analysis algorithms do not provide a suitable means for dealing with categorical data, uncertainty, and stability. The ability of decision making in the presence of vagueness and uncertainty in data can be handled using Rough Set Theory. Though, recent categorical clustering techniques based on Rough Set Theory help but they suffer from low accuracy, high computational complexity, and generalizability especially on data sets where they sometimes fail or hardly select their best clustering attribute. The main objective of this research is to propose a new information theoretic based Rough Purity Approach (RPA). Another objective of this work is to handle the problems of traditional Rough Set Theory based categorical clustering techniques. Hence, the ultimate goal is to cluster uncertain categorical datasets efficiently in terms of the performance, generalizability and computational complexity. The RPA takes into consideration information-theoretic attribute purity of the categorical-valued information systems. Several extensive experiments are conducted to evaluate the efficiency of RPA using a real Supplier Base Management (SBM) and six benchmark UCI datasets. The proposed RPA is also compared with several recent categorical data clustering techniques. The experimental results show that RPA outperforms the baseline algorithms. The significant percentage improvement with respect to time (66.70%), iterations (83.13%), purity (10.53%), entropy (14%), and accuracy (12.15%) as well as Rough Accuracy of clusters show that RPA is suitable for practical usage. We conclude that as compared to other techniques, the attribute purity of categorical-valued information systems can better cluster the data. Hence, RPA technique can be recommended for large scale clustering in multiple domains and its performance can be enhanced for further research.

Information-based Projection Method for Categorical Clustering and Outlier Detection

Categorical Clustering by Converting Associated Information

Homophily Outlier Detection in Non-IID Categorical Data

A Statistical Information-Based Clustering Approach in Distance Space

Clustering High-Dimensional Noisy Categorical Data

Clustering Categorical Data Based on Distance Vectors

An Optimization Model for Outlier Detection in Categorical Data

Enhanced Locality Sensitive Clustering in High Dimensional Space

A Deterministic Information Bottleneck Method for Clustering Mixed-Type Data

Mutual Information Scoring: Increasing Interpretability in Categorical Clustering Tasks with Applications to Child Welfare Data

A k-mean clustering algorithm for mixed numeric and categorical data

Rough set based information theoretic approach for clustering uncertain categorical data.

Fuzzy c-Means Clustering with Discriminative Projection

A new unsupervised outlier detection method

Significance-Based Decision Tree for Interpretable Categorical Data Clustering

Info-Detection: An Information-Theoretic Approach To Detect Outlier

Discovering Scene Categories by Information Projection and Cluster Sampling

A new model for natural groupings in high-dimensional data

Robust Subspace Outlier Detection in High Dimensional Space

EDMD: An Entropy based Dissimilarity measure to cluster Mixed-categorical Data

Outlier Cluster Formation in Spectral Clustering