Abstract:Cluster analysis requires many decisions: the clustering method and the implied reference model, the number of clusters and, often, several hyper-parameters and algorithms' tunings. In practice, one produces several partitions, and a final one is chosen based on validation or selection criteria. There exist an abundance of validation methods that, implicitly or explicitly, assume a certain clustering notion. Moreover, they are often restricted to operate on partitions obtained from a specific method. In this paper, we focus on groups that can be well separated by quadratic or linear boundaries. The reference cluster concept is defined through the quadratic discriminant score function and parameters describing clusters' size, center and scatter. We develop two cluster-quality criteria called quadratic scores. We show that these criteria are consistent with groups generated from a general class of elliptically-symmetric distributions. The quest for this type of groups is common in applications. The connection with likelihood theory for mixture models and model-based clustering is investigated. Based on bootstrap resampling of the quadratic scores, we propose a selection rule that allows choosing among many clustering solutions. The proposed method has the distinctive advantage that it can compare partitions that cannot be compared with other state-of-the-art methods. Extensive numerical experiments and the analysis of real data show that, even if some competing methods turn out to be superior in some setups, the proposed methodology achieves a better overall performance.

Cluster Number Selection for a Small Set of Samples Using the Bayesian

Selecting the number of clusters, clustering models, and algorithms. A unifying approach based on the quadratic discriminant score

How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis

Bayesian Clustering with Variable and Transformation Selections

Simultaneous Estimation of Number of Clusters and Feature Sparsity in Clustering High-Dimensional Data

Optimal Bayesian estimators for latent variable cluster models

Bayesian Adversarial Spectral Clustering With Unknown Cluster Number

Revisiting k-means: New Algorithms via Bayesian Nonparametrics

Asymptotic Results for the Estimation of the Quadratic Score of a Clustering

Statistical power for cluster analysis

A simulation study of cluster search algorithms in data set generated by Gaussian mixture models

Finding Outliers in Gaussian Model-based Clustering

Choosing models in model-based clustering and discriminant analysis

Simultaneous Clustering and Model Selection for Multinomial Distribution: A Comparative Study

Automated Model Selection of the Two-Layer Mixtures of Gaussian Process Functional Regressions for Curve Clustering and Prediction

A Bayesian approach for clustering and exact finite-sample model selection in longitudinal data mixtures

DP-space: Bayesian Nonparametric Subspace Clustering with Small-variance Asymptotics.

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

A Graph-based Approach to Estimating the Number of Clusters

Penalized model-based clustering with cluster-specific diagonal covariance matrices and grouped variables

A penalized criterion for selecting the number of clusters for K-medians