Abstract:Gaussian Mixture Model (GMM) is a probabilistic model for representing normally distributed subpopulations within an overall population. It is usually used for unsupervised learning to learn the subpopulations and the subpopulation assignment automatically. It is also used for supervised learning or classification to learn the boundary of subpopulations. However, the performance of GMM as a classifier is not impressive compared with other conventional classifiers such as k-nearest neighbors (KNN), support vector machine (SVM), decision tree and naive Bayes. In this paper, we attempt to address this problem. We propose a GMM classifier, SC-GMM, based on the separability criterion in order to separate the Gaussian models as much as possible. This classifier finds the optimal number of Gaussian components for each class based on the separability criterion and then determines the parameters of these Gaussian components by using the expectation maximization algorithm. Extensive experiments have been carried out on classification tasks from general data mining to face verification. Results show that SC-GMM significantly outperforms the original GMM classifier. Results also show that SC-GMM is comparable in classification accuracy to three variants of GMM classifier: Akaike Information Criterion based GMM (AIC-GMM), Bayesian Information Criterion based GMM (BIC-GMM) and variational Bayesian gaussian mixture (VBGM). However, SC-GMM is significantly more efficient than both AIC-GMM and BIC-GMM. Furthermore, compared with KNN, SVM, decision tree and naive Bayes, SC-GMM achieves competitive classification performance.

The SVM Classification Algorithm Based on Semi-Supervised Gauss Mixture Model Kernel

Novel semi-supervised classification algorithm based on TSVM

A Novel Semi-Supervised Classification Method Based on SVM

The Semi-Supervised SVM Classification Algorithm Based on Two-Stage Learning

A Cluster Kernel Semi-supervised Support Vector Machine Based on Spectral Clustering

Semisupervised Robust Modeling of Multimode Industrial Processes for Quality Variable Prediction Based on Student's T Mixture Model.

Semi-supervised Training Approach of SVM Based on Ant Clustering Algorithm

Distributed Online Semi-Supervised Support Vector Machine

Semisupervised SVM Batch Mode Active Learning with Applications to Image Retrieval

Semisupervised Bayesian Gaussian Mixture Models for Non-Gaussian Soft Sensor

Semi-Supervised Classification Based on Mixture Graph

Development of Co-Training Support Vector Machine Model for Semi-Supervised Classification

SVM based on new mixed kernel function

A New Semi-Supervised Classifier Based on Maximum Vector-Angular Margin

Support vector machine algorithm based on Gaussian mixture model and spatial ambiguity

Semisupervised Classification of Hyperspectral Image Based on Clustering Kernel and LS-SVM

A novel semisupervised SVM classifier based on active learning and 1 context information 2

A Novel Gaussian Mixture Model for Classification

Classification Method Based on Global and Local Support Vector Machine

A Novel Semi-Supervised Multi-Label Twin Support Vector Machine

A Novel Semi-supervised Classification Method Based on Class Certainty of Samples.