Abstract:Factor-analytic Gaussian mixture models are often employed as a model-based approach to clustering high-dimensional data. Typically, the numbers of clusters and latent factors must be specified in advance of model fitting, and remain fixed. The pair which optimises some model selection criterion is then chosen. For computational reasons, models in which the number of latent factors differ across clusters are rarely considered. Here the infinite mixture of infinite factor analysers (IMIFA) model is introduced. IMIFA employs a Pitman-Yor process prior to facilitate automatic inference of the number of clusters using the stick-breaking construction and a slice sampler. Furthermore, IMIFA employs multiplicative gamma process shrinkage priors to allow cluster-specific numbers of factors, automatically inferred via an adaptive Gibbs sampler. IMIFA is presented as the flagship of a family of factor-analytic mixture models, providing flexible approaches to clustering high-dimensional data. Applications to a benchmark data set, metabolomic spectral data, and a manifold learning handwritten digit example illustrate the IMIFA model and its advantageous features. These include obviating the need for model selection criteria, reducing the computational burden associated with the search of the model space, improving clustering performance by allowing cluster-specific numbers of factors, and quantifying uncertainty in the numbers of clusters and cluster-specific factors.

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Bayesian estimation and prediction for certain mixtures

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Overfitting Bayesian Mixtures of Factor Analyzers with an Unknown Number of Components

Multimode process data modeling: A Dirichlet process mixture model based Bayesian robust factor analyzer approach

Complex-valued Bayesian parameter estimation via Markov chain Monte Carlo

Bayesian finite mixtures of Ising models

Clustering Multivariate Data using Factor Analytic Bayesian Mixtures with an Unknown Number of Components

Model-based clustering based on sparse finite Gaussian mixtures

Bayesian mixture modeling for multivariate conditional distributions

Parsimonious Mixtures of Matrix Variate Bilinear Factor Analyzers

Model Selection for Mixtures of Factor Analyzers via Hierarchical BIC

Distributed Density Estimation Based on a Mixture of Factor Analyzers in a Sensor Network.

Uncommon Factors for Bayesian Asset Clusters

Conditional mixture modeling and model-based clustering

Finite Mixtures of Multivariate Poisson-Log Normal Factor Analyzers for Clustering Count Data

Mixture Model Averaging for Clustering

Infinite Mixtures of Infinite Factor Analysers

Bayesian inference for finite mixtures of univariate and multivariate skew-normal and skew-t distributions

Mixture Models With a Prior on the Number of Components