Abstract:Finite Gaussian mixture models are widely used for model-based clustering of continuous data. Nevertheless, since the number of model parameters scales quadratically with the number of variables, these models can be easily over-parameterized. For this reason, parsimonious models have been developed via covariance matrix decompositions or assuming local independence. However, these remedies do not allow for direct estimation of sparse covariance matrices nor do they take into account that the structure of association among the variables can vary from one cluster to the other. To this end, we introduce mixtures of Gaussian covariance graph models for model-based clustering with sparse covariance matrices. A penalized likelihood approach is employed for estimation and a general penalty term on the graph configurations can be used to induce different levels of sparsity and incorporate prior knowledge. Model estimation is carried out using a structural-EM algorithm for parameters and graph structure estimation, where two alternative strategies based on a genetic algorithm and an efficient stepwise search are proposed for inference. With this approach, sparse component covariance matrices are directly obtained. The framework results in a parsimonious model-based clustering of the data via a flexible model for the within-group joint distribution of the variables. Extensive simulated data experiments and application to illustrative datasets show that the method attains good classification performance and model quality.

Mixtures of skewed matrix variate bilinear factor analyzers

Parsimonious Mixtures of Matrix Variate Bilinear Factor Analyzers

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

On mean and/or variance mixtures of normal distributions

Model-based clustering via skewed matrix-variate cluster-weighted models

A Bayesian approach for clustering skewed data using mixtures of multivariate normal-inverse Gaussian distributions

Robust Classification via Finite Mixtures of Matrix Variate Skew-t Distributions

Finite Mixtures of Multivariate Poisson-Log Normal Factor Analyzers for Clustering Count Data

Infinite mixtures of multivariate normal-inverse Gaussian distributions for clustering of skewed data

Expectile Matrix Factorization for Skewed Data Analysis

Bayesian inference for finite mixtures of univariate and multivariate skew-normal and skew-t distributions

Clustering, classification, discriminant analysis, and dimension reduction via generalized hyperbolic mixtures

Variational Inference and Sparsity in High-Dimensional Deep Gaussian Mixture Models

A method of generating multivariate non-normal random numbers with desired multivariate skewness and kurtosis

The Effect of Skewness and Kurtosis on Mean and Covariance Structure Analysis

Clustering Multivariate Data using Factor Analytic Bayesian Mixtures with an Unknown Number of Components

Model-based Clustering with Sparse Covariance Matrices

Scale mixtures of multivariate centered skew-normal distributions

Flexible Clustering with a Sparse Mixture of Generalized Hyperbolic Distributions

Overfitting Bayesian Mixtures of Factor Analyzers with an Unknown Number of Components