Abstract:K-means is a well-known and widely used partitional clustering method. While there are considerable research efforts to characterize the key features of the K-means clustering algorithm, further investigation is needed to understand how data distributions can have impact on the performance of K-means clustering. To that end, in this paper, we provide a formal and organized study of the effect of skewed data distributions on K-means clustering. Along this line, we first formally illustrate that K-means tends to produce clusters of relatively uniform size, even if input data have varied "true" cluster sizes. In addition, we show that some clustering validation measures, such as the entropy measure, may not capture this uniform effect and provide misleading information on the clustering performance. Viewed in this light, we provide the coefficient of variation (CV) as a necessary criterion to validate the clustering results. Our findings reveal that K-means tends to produce clusters in which the variations of cluster sizes, as measured by CV, are in a range of about 0.3-1.0. Specifically, for data sets with large variation in "true" cluster sizes (e.g., CV > 1.0), K-means reduces variation in resultant cluster sizes to less than 1.0. In contrast, for data sets with small variation in "true" cluster sizes (e.g., CV < 0.3), K-means increases variation in resultant cluster sizes to greater than 0.3. In other words, for the earlier two cases, K-means produces the clustering results which are away from the "true" cluster distributions.

Validation of Overlapping Clustering: A Random Clustering Perspective

Towards understanding hierarchical clustering: A data distribution perspective

K-means Clustering Versus Validation Measures: a Data-Distribution Perspective

A New Validity Index Based on Intra-Cluster Variation and Inter-Cluster Overlap

A Fuzzy Cluster Validity Index Based on Clustering Mistake Measures

Improved Validation Index for Fuzzy Clustering

How to characterize imprecision in multi-view clustering?

The interelation in fuzzy clustering

Clustering Validation with The Area Under Precision-Recall Curves

Fuzzy C-Means Clustering Validity Function Based on Multiple Clustering Performance Evaluation Components

Accuracy Evaluation of Overlapping and Multi-resolution Clustering Algorithms on Large Datasets

External Validation Measures for K-means Clustering: A Data Distribution Perspective

A simple and fast method to determine the parameters for fuzzy c-means cluster validation

K-means clustering versus validation measures

Adapting the Right Measures for K-means Clustering

The interrelation in fuzzy clustering

Internal Purity: A Differential Entropy Based Internal Validation Index for Crisp and Fuzzy Clustering Validation

Efficient synthetical clustering validity indexes for hierarchical clustering

OMES: a new evaluation strategy using optimal matching for document clustering.

Deep Clustering Evaluation: How to Validate Internal Clustering Validation Measures

A Three-Way Clustering Mechanism to Handle Overlapping Regions