Abstract:Cluster analysis (Jain & Dubes, 1988) provides insight into the data by dividing the objects into groups (clusters), such that objects in a cluster are more similar to each other than objects in other clusters. Cluster analysis has long played an important role in a wide variety of fields, such as psychology, bioinformatics, pattern recognition, information retrieval, machine learning, and data mining. Many clustering algorithms, such as K-means and Unweighted Pair Group Method with Arithmetic Mean (UPGMA), have been wellestablished. A recent research focus on clustering analysis is to understand the strength and weakness of various clustering algorithms with respect to data factors. Indeed, people have identified some data characteristics that may strongly affect clustering analysis including high dimensionality and sparseness, the large size, noise, types of attributes and data sets, and scales of attributes (Tan, Steinbach, & Kumar, 2005). However, further investigation is expected to reveal whether and how the data distributions can have the impact on the performance of clustering algorithms. Along this line, we study clustering algorithms by answering three questions: 1. What are the systematic differences between the distributions of the resultant clusters by different clustering algorithms? 2. How can the distribution of the “true” cluster sizes make impact on the performances of clustering algorithms? 3. How to choose an appropriate clustering algorithm in practice? The answers to these questions can guide us for the better understanding and the use of clustering methods. This is noteworthy, since 1) in theory, people seldom realized that there are strong relationships between the clustering algorithms and the cluster size distributions, and 2) in practice, how to choose an appropriate clustering algorithm is still a challenging task, especially after an algorithm boom in data mining area. This chapter thus tries to fill this void initially. To this end, we carefully select two widely used categories of clustering algorithms, i.e., K-means and Agglomerative Hierarchical Clustering (AHC), as the representative algorithms for illustration. In the chapter, we first show that K-means tends to generate the clusters with a relatively uniform distribution on the cluster sizes. Then we demonstrate that UPGMA, one of the robust AHC methods, acts in an opposite way to K-means; that is, UPGMA tends to generate the clusters with high variation on the cluster sizes. Indeed, the experimental results indicate that the variations of the resultant cluster sizes by K-means and UPGMA, measured by the Coefficient of Variation (CV), are in the specific intervals, say [0.3, 1.0] and [1.0, 2.5] respectively. Finally, we put together K-means and UPGMA for a further comparison, and propose some rules for the better choice of the clustering schemes from the data distribution point of view.

Selecting Appropriate Clustering Methods for Materials Science Applications of Machine Learning

Quantifying the CVD-grown Two-Dimensional Materials Via Image Clustering.

A Comparative Study of Clustering Methods for Nanoindentation Mapping Data

Comprehensive analysis of clustering algorithms: exploring limitations and innovative solutions

Data-Driven Materials Discovery and Synthesis using Machine Learning Methods

A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects

A strategy to apply machine learning to small datasets in materials science

G2-SCANN: Gaussian-kernel Graph-Based SLD Clustering Algorithm with Natural Neighbourhood

Clustering discretization methods for generation of material performance databases in machine learning and design optimization

New approaches for clustering high dimensional data

A Review of the Application of Machine Learning and Data Mining Approaches in Continuum Materials Mechanics

Using Ripley's K-function to Characterize Clustering In 3-Dimensional Point Patterns With a Case Study in Atom Probe Tomography

Distance-based Analysis of Machine Learning Prediction Reliability for Datasets in Materials Science and Other Fields

Statistical power for cluster analysis

Application of Machine Learning in Material Synthesis and Property Prediction

A Data Distribution View of Clustering Algorithms

Clustering strategy and method selection

Application of machine learning for advanced material prediction and design

Outlier Factor Based Partitional Clustering Analysis with Constraints Discovery and Representative Objects Generation

Metrics for quantifying isotropy in high dimensional unsupervised clustering tasks in a materials context