Abstract:We introduce a novel statistical procedure for clustering categorical data based on Hamming distance (HD) vectors. The proposed method is conceptually simple and computationally straightforward, because it does not require any specific statistical models or any convergence criteria. Moreover, unlike most currently existing algorithms that compute the class membership or membership probability for every data point at each iteration, our algorithm sequentially extracts clusters from the given dataset. That is, at each iteration our algorithm strives to identify only one cluster, which will then be deleted from the dataset at the next iteration; this procedure repeats until there are no more significant clusters in the remaining data. Consequently, the number of clusters can be determined automatically by the algorithm. As for the identification and extraction of a cluster, we first locate the cluster center by using a Pearson chi-squared-type statistic on the basis of HD vectors. The partition of the dataset produced by our algorithm is unique and insensitive to the input order of data points. The performance of the proposed algorithm is examined using both simulated and real world datasets. Comparisons with two well-known clustering algorithms, K-modes and AutoClass, show that the proposed algorithm substantially outperforms these competitors, with the classification rate or the information gain typically improved by several orders of magnitude. Computational complexity and run time comparisons are also provided.

K-Histograms: an Efficient Clustering Algorithm for Categorical Dataset

K-ANMI: A Mutual Information Based Clustering Algorithm for Categorical Data

Clustering Categorical Data Based on Distance Vectors

A Global K-modes Algorithm for Clustering Categorical Data

Clustering Categorical Data Streams

Categorical data clustering: 25 years beyond K-modes

A k-mean clustering algorithm for mixed numeric and categorical data

A method for k-means-like clustering of categorical data

Clustering Categorical Data:A Cluster Ensemble Approach

Clustering Categorical Data Using Coverage Density

A Parallel Clustering Algorithm for Categorical Data Set

Clustering Algorithm for Boolean and Categorical Data

A Fuzzy K-Prototype Clustering Algorithm for Mixed Numeric and Categorical Data

A Hash-based Co-Clustering Algorithm for Categorical Data

Robust $K$-Means-type Clustering for Noisy Data

Approximation Algorithms for K-Modes Clustering

Histogram-based Colour Image Fuzzy Clustering Algorithm

A Testing-Based Approach to Assess the Clusterability of Categorical Data.

Exploration of Hybrid Multi-Dimensional Histograms for Hybrid Multi-Dimensional Data Distribution

A Novel K '-Means Algorithm For Clustering Analysis

HOT: Hypergraph-Based Outlier Test for Categorical Data.