Abstract:Cluster analysis (Jain & Dubes, 1988) provides insight into the data by dividing the objects into groups (clusters), such that objects in a cluster are more similar to each other than objects in other clusters. Cluster analysis has long played an important role in a wide variety of fields, such as psychology, bioinformatics, pattern recognition, information retrieval, machine learning, and data mining. Many clustering algorithms, such as K-means and Unweighted Pair Group Method with Arithmetic Mean (UPGMA), have been wellestablished. A recent research focus on clustering analysis is to understand the strength and weakness of various clustering algorithms with respect to data factors. Indeed, people have identified some data characteristics that may strongly affect clustering analysis including high dimensionality and sparseness, the large size, noise, types of attributes and data sets, and scales of attributes (Tan, Steinbach, & Kumar, 2005). However, further investigation is expected to reveal whether and how the data distributions can have the impact on the performance of clustering algorithms. Along this line, we study clustering algorithms by answering three questions: 1. What are the systematic differences between the distributions of the resultant clusters by different clustering algorithms? 2. How can the distribution of the “true” cluster sizes make impact on the performances of clustering algorithms? 3. How to choose an appropriate clustering algorithm in practice? The answers to these questions can guide us for the better understanding and the use of clustering methods. This is noteworthy, since 1) in theory, people seldom realized that there are strong relationships between the clustering algorithms and the cluster size distributions, and 2) in practice, how to choose an appropriate clustering algorithm is still a challenging task, especially after an algorithm boom in data mining area. This chapter thus tries to fill this void initially. To this end, we carefully select two widely used categories of clustering algorithms, i.e., K-means and Agglomerative Hierarchical Clustering (AHC), as the representative algorithms for illustration. In the chapter, we first show that K-means tends to generate the clusters with a relatively uniform distribution on the cluster sizes. Then we demonstrate that UPGMA, one of the robust AHC methods, acts in an opposite way to K-means; that is, UPGMA tends to generate the clusters with high variation on the cluster sizes. Indeed, the experimental results indicate that the variations of the resultant cluster sizes by K-means and UPGMA, measured by the Coefficient of Variation (CV), are in the specific intervals, say [0.3, 1.0] and [1.0, 2.5] respectively. Finally, we put together K-means and UPGMA for a further comparison, and propose some rules for the better choice of the clustering schemes from the data distribution point of view.

Regression Tree and Clustering for Distributions, and Homogeneous Structure of Population Characteristics

Hierarchical Cluster Analysis In Clinical Research With Heterogeneous Study Population: Highlighting Its Visualization With R

Clustering populations by mixed linear models

Quantifying Effects of Habitat Heterogeneity and Other Clustering Processes on Spatial Distributions of Tree Species

Towards understanding hierarchical clustering: A data distribution perspective

The Semi-Hierarchical Dirichlet Process and Its Application to Clustering Homogeneous Distributions

A Statistical Information-Based Clustering Approach in Distance Space

Clustering of heterogeneous populations of networks

A Data Distribution View of Clustering Algorithms

Heterogeneity Pursuit for Spatial Point Pattern with Application to Tree Locations: A Bayesian Semiparametric Recourse

Spatial Homogeneity Pursuit of Regression Coefficients for Large Datasets

Paralinear Distance and Its Algorithm for Hierarchical Clustering of High-dimensional Discrete Variables

Clustering on hierarchical heterogeneous data with prior pairwise relationships

Spatially Clustered Regression

Inferring weak population structure with the assistance of sample group information

Clustering by measuring local direction centrality for data with heterogeneous density and weak connectivity

Clustering Time Series Utilizing A Dimension Hierarchical Decomposition Approach

Data Structures & Algorithms for Exact Inference in Hierarchical Clustering

Optimally Ordered Orthogonal Neighbor Joining Trees for Hierarchical Cluster Analysis

Regression and Subgroup Detection for Heterogeneous Samples

Flexible Clustering by Tendency in High Dimensional Space