Abstract:We introduce a novel statistical procedure for clustering categorical data based on Hamming distance (HD) vectors. The proposed method is conceptually simple and computationally straightforward, because it does not require any specific statistical models or any convergence criteria. Moreover, unlike most currently existing algorithms that compute the class membership or membership probability for every data point at each iteration, our algorithm sequentially extracts clusters from the given dataset. That is, at each iteration our algorithm strives to identify only one cluster, which will then be deleted from the dataset at the next iteration; this procedure repeats until there are no more significant clusters in the remaining data. Consequently, the number of clusters can be determined automatically by the algorithm. As for the identification and extraction of a cluster, we first locate the cluster center by using a Pearson chi-squared-type statistic on the basis of HD vectors. The partition of the dataset produced by our algorithm is unique and insensitive to the input order of data points. The performance of the proposed algorithm is examined using both simulated and real world datasets. Comparisons with two well-known clustering algorithms, K-modes and AutoClass, show that the proposed algorithm substantially outperforms these competitors, with the classification rate or the information gain typically improved by several orders of magnitude. Computational complexity and run time comparisons are also provided.

Clustering Algorithm for Boolean and Categorical Data

A Link Clustering Based Approach for Clustering Categorical Data

Clustering Categorical Data Based on Distance Vectors

Clustering ensemble algorithm for categorical data

Soft Subspace Clustering of Categorical Data with Probabilistic Distance

Low Dimensional Representation of Space Structure and Clustering of Categorical Data

Clustering Categorical Data Using Coverage Density

Fuzzy Rough Clustering for Categorical Data

Categorical data clustering: 25 years beyond K-modes

ROCK: a robust clustering algorithm for categorical attributes

K-ANMI: A Mutual Information Based Clustering Algorithm for Categorical Data

A Cluster Ensemble Method for Clustering Categorical Data

ESCHCD: entropy-based algorithm for subspace clustering with high dimensional categorical datasets

Categorical Clustering by Converting Associated Information

K-Histograms: an Efficient Clustering Algorithm for Categorical Dataset

Study on consensus function based on clustering algorithms of categorical data

Clustering High-Dimensional Noisy Categorical Data

Clustering Categorical Data:A Cluster Ensemble Approach

A Hash-based Co-Clustering Algorithm for Categorical Data

A method for k-means-like clustering of categorical data

Clusterability test for categorical data