Abstract:Gaussian Mixture Model (GMM) is a probabilistic model for representing normally distributed subpopulations within an overall population. It is usually used for unsupervised learning to learn the subpopulations and the subpopulation assignment automatically. It is also used for supervised learning or classification to learn the boundary of subpopulations. However, the performance of GMM as a classifier is not impressive compared with other conventional classifiers such as k-nearest neighbors (KNN), support vector machine (SVM), decision tree and naive Bayes. In this paper, we attempt to address this problem. We propose a GMM classifier, SC-GMM, based on the separability criterion in order to separate the Gaussian models as much as possible. This classifier finds the optimal number of Gaussian components for each class based on the separability criterion and then determines the parameters of these Gaussian components by using the expectation maximization algorithm. Extensive experiments have been carried out on classification tasks from general data mining to face verification. Results show that SC-GMM significantly outperforms the original GMM classifier. Results also show that SC-GMM is comparable in classification accuracy to three variants of GMM classifier: Akaike Information Criterion based GMM (AIC-GMM), Bayesian Information Criterion based GMM (BIC-GMM) and variational Bayesian gaussian mixture (VBGM). However, SC-GMM is significantly more efficient than both AIC-GMM and BIC-GMM. Furthermore, compared with KNN, SVM, decision tree and naive Bayes, SC-GMM achieves competitive classification performance.

A Novel Finite Mixture Model Based on Generalized Scale Mixtures of Generalized Normal Distributions with Application to Stock Dataset

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications

The generalized scale mixtures of asymmetric generalized normal distributions with application to stock data

Gaussian mixture density modeling and decomposition with weighted likelihood

A Novel Finite Mixture Model Based on the Generalized T Distributions with Two-Sided Censored Data

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Numerical characteristics and parameter estimation of finite mixed generalized normal distribution

A Robust Infinite Gaussian Mixture Model and Its Application in Fault Detection of Nonlinear Multimode Processes

A Generalized Finite Mixture Model for Asymmetric Probability Distribution Observations

Scale Mixture of Gleser Distribution with an Application to Insurance Data

A general robust approach for joint modeling of the family of scale mixture of Normal distribution

Model-based clustering based on sparse finite Gaussian mixtures

Modelling financial returns with mixtures of generalized normal distributions

A Novel Gaussian Mixture Model for Classification

A Generalized Mixture Integer-Valued GARCH Model

Modelling financial time series based on heavy-tailed market microstructure models with scale mixtures of normal distributions

Ordering results between two finite arithmetic mixture models with multiple-outlier location-scale distributed components

A Class of Finite Mixture of Quantile Regressions with Its Applications

Extending Growth Mixture Models Using Continuous Non-Elliptical Distributions

Probabilistic Classifiers with a Generalized Gaussian Scale Mixture Prior

A Family of Finite Mixture Distributions for Modelling Dispersion in Count Data