Abstract:Clustering is a central approach for unsupervised learning. After clustering is applied, the most fundamental analysis is to quantitatively compare clusterings. Such comparisons are crucial for the evaluation of clustering methods as well as other tasks such as consensus clustering. It is often argued that, in order to establish a baseline, clustering similarity should be assessed in the context of a random ensemble of clusterings. The prevailing assumption for the random clustering ensemble is the permutation model in which the number and sizes of clusters are fixed. However, this assumption does not necessarily hold in practice; for example, multiple runs of K-means clustering returns clusterings with a fixed number of clusters, while the cluster size distribution varies greatly. Here, we derive corrected variants of two clustering similarity measures (the Rand index and Mutual Information) in the context of two random clustering ensembles in which the number and sizes of clusters vary. In addition, we study the impact of one-sided comparisons in the scenario with a reference clustering. The consequences of different random models are illustrated using synthetic examples, handwriting recognition, and gene expression data. We demonstrate that the choice of random model can have a drastic impact on the ranking of similar clustering pairs, and the evaluation of a clustering method with respect to a random baseline; thus, the choice of random clustering model should be carefully justified.

Choquet random sup-measures with aggregations

Asymptotic analysis of random partitions ∗

On Increments of Sums of Random-Variables Without Moment Hypotheses

A family of random sup-measures with long-range dependence

Precise determination of non-additive measures

The Choquet-like operator with respect to an admissible order as a tool for aggregating multivalued data

Uniform decomposition of probability measures: quantization, clustering and rate of convergence

Increasing Convex Order on Generalized Aggregation of SAI Random Variables with Applications

An ergodic support of a dynamical system and a natural representation of Choquet distributions for invariant measures

Asymptotics for Optimal Empirical Quantization of Measures

Uncertainty Quantification by Random Measures and Fields

Asymptotic expected sensitivity function and its applications to measures of monotone association

Random signed measures

Random Expansive Measures

Shuffle of Min's Random Variable Approximations of Bivariate Copulas' Realization

Random distortion risk measures

The Impact of Random Models on Clustering Similarity

Majorization and randomness measures

An unexpected stochastic dominance: Pareto distributions, dependence, and diversification

Minimizers for an aggregation model with attractive-repulsive interaction

Transportation of random measures not charging small sets