Abstract:Cluster analysis (Jain & Dubes, 1988) provides insight into the data by dividing the objects into groups (clusters), such that objects in a cluster are more similar to each other than objects in other clusters. Cluster analysis has long played an important role in a wide variety of fields, such as psychology, bioinformatics, pattern recognition, information retrieval, machine learning, and data mining. Many clustering algorithms, such as K-means and Unweighted Pair Group Method with Arithmetic Mean (UPGMA), have been wellestablished. A recent research focus on clustering analysis is to understand the strength and weakness of various clustering algorithms with respect to data factors. Indeed, people have identified some data characteristics that may strongly affect clustering analysis including high dimensionality and sparseness, the large size, noise, types of attributes and data sets, and scales of attributes (Tan, Steinbach, & Kumar, 2005). However, further investigation is expected to reveal whether and how the data distributions can have the impact on the performance of clustering algorithms. Along this line, we study clustering algorithms by answering three questions: 1. What are the systematic differences between the distributions of the resultant clusters by different clustering algorithms? 2. How can the distribution of the “true” cluster sizes make impact on the performances of clustering algorithms? 3. How to choose an appropriate clustering algorithm in practice? The answers to these questions can guide us for the better understanding and the use of clustering methods. This is noteworthy, since 1) in theory, people seldom realized that there are strong relationships between the clustering algorithms and the cluster size distributions, and 2) in practice, how to choose an appropriate clustering algorithm is still a challenging task, especially after an algorithm boom in data mining area. This chapter thus tries to fill this void initially. To this end, we carefully select two widely used categories of clustering algorithms, i.e., K-means and Agglomerative Hierarchical Clustering (AHC), as the representative algorithms for illustration. In the chapter, we first show that K-means tends to generate the clusters with a relatively uniform distribution on the cluster sizes. Then we demonstrate that UPGMA, one of the robust AHC methods, acts in an opposite way to K-means; that is, UPGMA tends to generate the clusters with high variation on the cluster sizes. Indeed, the experimental results indicate that the variations of the resultant cluster sizes by K-means and UPGMA, measured by the Coefficient of Variation (CV), are in the specific intervals, say [0.3, 1.0] and [1.0, 2.5] respectively. Finally, we put together K-means and UPGMA for a further comparison, and propose some rules for the better choice of the clustering schemes from the data distribution point of view.

A Comparative Agglomerative Hierarchical Clustering Method to Cluster Implemented Course

Agglomerative Nesting (AGNES) Method and Divisive Analysis (DIANA) Method For Hierarchical Clustering On Some Distance Measurement Concepts

A Comparative Analysis of Clustering Algorithms for Assessing College Students’ Key Competencies

Data Aggregation for Hierarchical Clustering

The Implementation of K-Means Clustering on E-Learning Feature Development for Outstanding Student Recommendation

A Multi-disciplinary Ensemble Algorithm for Clustering Heterogeneous Datasets

Scalable Hierarchical Agglomerative Clustering

Cluster Merging and Splitting in Hierarchical Clustering Algorithms

Developing ensemble clustering through similarity measures: A semi‐supervised hierarchical clustering learning

Hierarchical Cluster Analysis In Clinical Research With Heterogeneous Study Population: Highlighting Its Visualization With R

Supervised Hierarchical Clustering with Exponential Linkage

Efficient hierarchical clustering of large high dimensional datasets.

Semi-supervised Hierarchical Ensemble Clustering Based on an Innovative Distance Metric and Constraint Information

Divisive Hierarchical Clustering with K-means and Agglomerative Hierarchical Clustering

A Data Distribution View of Clustering Algorithms

A Novel Hierarchical Clustering Algorithm with Merging Strategy Based on Shared Subordinates

Analysis of the Effectiveness of Online Learning Using Eda Data Science and Machine Learning

Order preserving hierarchical agglomerative clustering

A Coding Hierarchy Computing Based Clustering Algorithm

Comparison of Algorithms K-Means and DBSCAN for Clustering Student Cognitive Learning Outcomes in Physics Subject

Agglomerative Clustering in Uniform and Proportional Feature Spaces