Abstract:Mixture model based clustering (also simply called model-based clustering hereinafter) consists of fitting a mixture model to data and identifying each cluster with one of its components. This paper tackles the model selection and parameter estimation problems in model-based clustering so as to improve the clustering performance on the data sets whose true kernel distribution functions are not in the family of assumed ones, as well as with inherently overlapped clusters. Being tailored to clustering applications, an effective model selection criterion is first proposed. Unlike most criteria that measure the goodness-of-fit of the model only to generate data, the proposed one also evaluates whether the candidate model provides a reasonable partition for the observed data, which enforces a model with well-separated components. Accordingly, an improved method for the estimation of mixture parameters is derived, which aims to suppress the spurious estimates by the standard expectation maximization (EM) algorithm and enforce well-supported components in the mixture model. Finally, the estimation of mixture parameters and the model selection is integrated in a single algorithm which favors a compact mixture model with both the well-supported and well-separated components. Extensive experiments on synthetic and real-world data sets are carried out to show the effectiveness of the proposed approach to the mixture model based clustering.

Dendrogram of mixing measures: Hierarchical clustering and model selection for finite mixture models

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Hierarchical Mixture of Finite Mixtures

Inferring Hierarchical Mixture Structures: A Bayesian Nonparametric Approach

Mixture Model Averaging for Clustering

Evaluating mixture modeling for clustering: Recommendations and cautions.

MixtureFinder: Estimating DNA mixture models for phylogenetic analyses

CDP Mixture Models for Data Clustering

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Measuring similarity between two mixture trees using mixture distance metric and algorithms

Learning a Mixture Model for Clustering with the Completed Likelihood Minimum Message Length Criterion

Mixture Models With a Prior on the Number of Components

Bayesian approaches to variable selection in mixture models with application to disease clustering

A Bayesian approach for clustering and exact finite-sample model selection in longitudinal data mixtures

Learning with mixtures of trees

Model Selection for Mixtures of Factor Analyzers via Hierarchical BIC

Maximum Likelihood Estimation for Single Linkage Hierarchical Clustering

Overfitting Bayesian Mixtures of Factor Analyzers with an Unknown Number of Components

Bayesian Mixture Models With Focused Clustering for Mixed Ordinal and Nominal Data

Dynamical mixture modeling with fast, automatic determination of Markov chains

Model-based clustering based on sparse finite Gaussian mixtures