Abstract:Cluster analysis is a method that identifies similar groups of data without any prior knowledge of the relevant groups. One of the most widely used clustering methods is model-based clustering, in which data clustering is performed by fitting a probabilistic model to the data. Mixture of Gaussian distributions is a commonly used model in model-based clustering. Unfortunately, the number of covariance matrices parameters rapidly increases by increasing the number of variables or components in these models. So far, various classes of the parsimonious Gaussian mixture models, by applying various constraints on the covariance matrices, have been introduced to solve this problem. Unfortunately, the number of models in each of these classes is so small such that in practice it does not allow the study and selection of models with any number of parameters, which can vary between the minimum number (one parameter) and the maximum number (no constraints model) of parameters. In this paper, to deal with this problem a family of the parsimonious Gaussian mixture models is introduced. This is done by identifying and determining the appropriate partitions of the variances and correlation coefficients between variables among clusters. We call these models "the parsimonious Gaussian mixture models with partitioned parameters". The generalized Expectation-Conditional Maximization algorithm, by employing the Fisher scoring method within the algorithm, is used to compute the maximum likelihood estimates of parameters. Bayesian information criterion is used for comparing and selecting the best model. Also, the steepest ascent method is adapted to search the best model. Finally, performances of these models are examined on two real datasets and a brief simulation study.

DNA-binding proteins and their cis-acting sites controlling hormonal induction of a mouse beta-casein::CAT fusion protein in mammary epithelial cells.

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Bayesian estimation and prediction for certain mixtures

On mean and/or variance mixtures of normal distributions

The parsimonious Gaussian mixture models with partitioned parameters and their application in clustering

Conditional mixture modeling and model-based clustering

Model-based clustering based on sparse finite Gaussian mixtures

Parameter estimation for stable distributions and their mixture

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models

Finite Mixtures of Multivariate Poisson-Log Normal Factor Analyzers for Clustering Count Data

Parsimonious ultrametric Gaussian mixture models

A parsimonious family of multivariate Poisson-lognormal distributions for clustering multivariate count data

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Flexible Clustering with a Sparse Mixture of Generalized Hyperbolic Distributions

Clustering Multivariate Data using Factor Analytic Bayesian Mixtures with an Unknown Number of Components

A Nonparametric Estimation Method for the Multivariate Mixture Models

Numerical characteristics and parameter estimation of finite mixed generalized normal distribution

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

Testing the Order of Multivariate Normal Mixture Models

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications

Consistency for constrained maximum likelihood estimation and clustering based on mixtures of elliptically-symmetric distributions under general data generating processes