Abstract:Cluster analysis (Jain & Dubes, 1988) provides insight into the data by dividing the objects into groups (clusters), such that objects in a cluster are more similar to each other than objects in other clusters. Cluster analysis has long played an important role in a wide variety of fields, such as psychology, bioinformatics, pattern recognition, information retrieval, machine learning, and data mining. Many clustering algorithms, such as K-means and Unweighted Pair Group Method with Arithmetic Mean (UPGMA), have been wellestablished. A recent research focus on clustering analysis is to understand the strength and weakness of various clustering algorithms with respect to data factors. Indeed, people have identified some data characteristics that may strongly affect clustering analysis including high dimensionality and sparseness, the large size, noise, types of attributes and data sets, and scales of attributes (Tan, Steinbach, & Kumar, 2005). However, further investigation is expected to reveal whether and how the data distributions can have the impact on the performance of clustering algorithms. Along this line, we study clustering algorithms by answering three questions: 1. What are the systematic differences between the distributions of the resultant clusters by different clustering algorithms? 2. How can the distribution of the “true” cluster sizes make impact on the performances of clustering algorithms? 3. How to choose an appropriate clustering algorithm in practice? The answers to these questions can guide us for the better understanding and the use of clustering methods. This is noteworthy, since 1) in theory, people seldom realized that there are strong relationships between the clustering algorithms and the cluster size distributions, and 2) in practice, how to choose an appropriate clustering algorithm is still a challenging task, especially after an algorithm boom in data mining area. This chapter thus tries to fill this void initially. To this end, we carefully select two widely used categories of clustering algorithms, i.e., K-means and Agglomerative Hierarchical Clustering (AHC), as the representative algorithms for illustration. In the chapter, we first show that K-means tends to generate the clusters with a relatively uniform distribution on the cluster sizes. Then we demonstrate that UPGMA, one of the robust AHC methods, acts in an opposite way to K-means; that is, UPGMA tends to generate the clusters with high variation on the cluster sizes. Indeed, the experimental results indicate that the variations of the resultant cluster sizes by K-means and UPGMA, measured by the Coefficient of Variation (CV), are in the specific intervals, say [0.3, 1.0] and [1.0, 2.5] respectively. Finally, we put together K-means and UPGMA for a further comparison, and propose some rules for the better choice of the clustering schemes from the data distribution point of view.

A new approach to generate diversified clusters for small data sets

Clustering Ensemble with High Diversity Based on Adding Artificial Data

A Method of Data Mining Based on SOM Clustering and Its Application

A boosted clustering algorithm for distributed homogeneous data mining

New approaches for clustering high dimensional data

A Statistical Information-Based Clustering Approach in Distance Space

A Dynamic Clustering Algorithm Based on Small Data Set

Hybrid bio-inspired user clustering for the generation of diversified recommendations

Clustering in Dynamic Environments: A Framework for Benchmark Dataset Generation With Heterogeneous Changes

Toward Multidiversified Ensemble Clustering of High-Dimensional Data: From Subspaces to Metrics and Beyond

A Clustering Method Based on Multi-Positive–negative Granularity and Attenuation-Diffusion Pattern

Mostly Beneficial Clustering: Aggregating Data for Operational Decision Making

A Differential Evolution Algorithm With Adaptive Niching and K-Means Operation for Data Clustering

A Domain Adaptive Density Clustering Algorithm for Data with Varying Density Distribution

A Data Distribution View of Clustering Algorithms

A Novel Density Peaks Clustering Algorithm for Mixed Data

Heterogeneity-aware Clustered Distributed Learning for Multi-source Data Analysis

An Effective and Efficient Approach for Clusterability Evaluation

A Data-Driven Approach for Extracting Representative Information from Large Datasets with Mixed Attributes

CLINCH: clustering incomplete high-dimensional data for data mining application

Clustering by Heterogeneous Data Fusion : Framework and Applications