Abstract:Cluster analysis is a method that identifies similar groups of data without any prior knowledge of the relevant groups. One of the most widely used clustering methods is model-based clustering, in which data clustering is performed by fitting a probabilistic model to the data. Mixture of Gaussian distributions is a commonly used model in model-based clustering. Unfortunately, the number of covariance matrices parameters rapidly increases by increasing the number of variables or components in these models. So far, various classes of the parsimonious Gaussian mixture models, by applying various constraints on the covariance matrices, have been introduced to solve this problem. Unfortunately, the number of models in each of these classes is so small such that in practice it does not allow the study and selection of models with any number of parameters, which can vary between the minimum number (one parameter) and the maximum number (no constraints model) of parameters. In this paper, to deal with this problem a family of the parsimonious Gaussian mixture models is introduced. This is done by identifying and determining the appropriate partitions of the variances and correlation coefficients between variables among clusters. We call these models "the parsimonious Gaussian mixture models with partitioned parameters". The generalized Expectation-Conditional Maximization algorithm, by employing the Fisher scoring method within the algorithm, is used to compute the maximum likelihood estimates of parameters. Bayesian information criterion is used for comparing and selecting the best model. Also, the steepest ascent method is adapted to search the best model. Finally, performances of these models are examined on two real datasets and a brief simulation study.

An Automatic Clustering Algorithm Based on a Competition Model of Probabilistic PCA

A comparative study on selection of cluster number and local subspace dimension in the mixture PCA models

Robust modeling of mixture probabilistic principal component analysis and process monitoring application

Automatic clustering approach based on particle swarm optimization for data with arbitrary shaped clusters

Repulsive Mixture Models of Exponential Family PCA for Clustering

Gaussian Mixture Learning Via Robust Competitive Agglomeration

How Many Clusters? A Robust PSO-based Local Density Model

Rival Penalized Competitive Learning, Finite Mixture, And Multisets Clustering

Robust Subspace Clustering Via Penalized Mixture of Gaussians.

Automatic Clustering Using Genetic Algorithms

Automatic Parameter Selection for Non-Redundant Clustering

A Nonparametric Model for Multi-Manifold Clustering with Mixture of Gaussians and Graph Consistency

RPCL-based Local PCA Algorithm

The parsimonious Gaussian mixture models with partitioned parameters and their application in clustering

Possibilistic C-Means Clustering Algorithms Based on Adaptive Nearest Neighbors

A Probabilistic Approach to Latent Cluster Analysis

Determining The Number Of Probability-Based Clustering: A Hybrid Approach

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Uncertain Data Clustering Based on Probability Distribution in Obstacle Space

Entropy Penalized Automated Model Selection On Gaussian Mixture

A New Local PCA-SOM Algorithm