Abstract:Gaussian Mixture Model (GMM) is a probabilistic model for representing normally distributed subpopulations within an overall population. It is usually used for unsupervised learning to learn the subpopulations and the subpopulation assignment automatically. It is also used for supervised learning or classification to learn the boundary of subpopulations. However, the performance of GMM as a classifier is not impressive compared with other conventional classifiers such as k-nearest neighbors (KNN), support vector machine (SVM), decision tree and naive Bayes. In this paper, we attempt to address this problem. We propose a GMM classifier, SC-GMM, based on the separability criterion in order to separate the Gaussian models as much as possible. This classifier finds the optimal number of Gaussian components for each class based on the separability criterion and then determines the parameters of these Gaussian components by using the expectation maximization algorithm. Extensive experiments have been carried out on classification tasks from general data mining to face verification. Results show that SC-GMM significantly outperforms the original GMM classifier. Results also show that SC-GMM is comparable in classification accuracy to three variants of GMM classifier: Akaike Information Criterion based GMM (AIC-GMM), Bayesian Information Criterion based GMM (BIC-GMM) and variational Bayesian gaussian mixture (VBGM). However, SC-GMM is significantly more efficient than both AIC-GMM and BIC-GMM. Furthermore, compared with KNN, SVM, decision tree and naive Bayes, SC-GMM achieves competitive classification performance.

A multi-manifold semi-supervised Gaussian mixture model for pattern classification

A Novel Image Classification Method Based on Manifold Learning and Gaussian Mixture Model

Manifold Regularized Gaussian Mixture Model for Semi-supervised Clustering.

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

Geodesic Based Semi-supervised Multi-manifold Feature Extraction

Manifold-based multi-graph embedding for semi-supervised classification

Semisupervised Robust Modeling of Multimode Industrial Processes for Quality Variable Prediction Based on Student's T Mixture Model.

A Nonparametric Model for Multi-Manifold Clustering with Mixture of Gaussians and Graph Consistency

Semisupervised Bayesian Gaussian Mixture Models for Non-Gaussian Soft Sensor

Enhanced Manifold Regularization for Semi-Supervised Classification.

Unsupervised Multi-class Sentiment Classification Approach

Geodesic Multi-Class SVM with Stiefel Manifold Embedding.

Data Classification Algorithm on Multi-Manifold

Semi-supervised discriminant analysis on Grassmannian manifold

The Supervised Learning Gaussian Mixture Model

Semisupervised Feature Selection via Structured Manifold Learning

Refining Gaussian Mixture Model Based on Enhanced Manifold Learning.

An Unsupervised Gaussian Mixture Classification Mechanism Based on Statistical Learning Analysis

A Novel Gaussian Mixture Model for Classification

Semi-supervised Learning Framework Based on Statistical Analysis for Image Set Classification

Semi-Supervised Classification Based on Mixture Graph