Abstract:Gaussian Mixture Model (GMM) is a probabilistic model for representing normally distributed subpopulations within an overall population. It is usually used for unsupervised learning to learn the subpopulations and the subpopulation assignment automatically. It is also used for supervised learning or classification to learn the boundary of subpopulations. However, the performance of GMM as a classifier is not impressive compared with other conventional classifiers such as k-nearest neighbors (KNN), support vector machine (SVM), decision tree and naive Bayes. In this paper, we attempt to address this problem. We propose a GMM classifier, SC-GMM, based on the separability criterion in order to separate the Gaussian models as much as possible. This classifier finds the optimal number of Gaussian components for each class based on the separability criterion and then determines the parameters of these Gaussian components by using the expectation maximization algorithm. Extensive experiments have been carried out on classification tasks from general data mining to face verification. Results show that SC-GMM significantly outperforms the original GMM classifier. Results also show that SC-GMM is comparable in classification accuracy to three variants of GMM classifier: Akaike Information Criterion based GMM (AIC-GMM), Bayesian Information Criterion based GMM (BIC-GMM) and variational Bayesian gaussian mixture (VBGM). However, SC-GMM is significantly more efficient than both AIC-GMM and BIC-GMM. Furthermore, compared with KNN, SVM, decision tree and naive Bayes, SC-GMM achieves competitive classification performance.

A Novel Image Classifier Based on Gaussian Mixture Language Model

A Novel Image Classification Method Based on Manifold Learning and Gaussian Mixture Model

Gaussian mixture model with semantic distance for image classification

A Novel Gaussian Mixture Model for Classification

Visual language modeling for image classification.

Discriminating Semantic Visual Words for Scene Classification.

Learning a field of Gaussian mixture model for image classification

Soft Measure of Visual Token Occurrences for Object Categorization

Towards Effective Codebookless Model for Image Classification

Fine-Grained Image Classification with Gaussian Mixture Layer

A new bag of words model based on fuzzy membership for image description

Image Segmentation Based on Spatially Coherent Gaussian Mixture Model

New Linear Discriminant Analysis Based on Gaussian Mixture Model

Learning Gaussian mixture model with a maximization-maximization algorithm for image classification

Shaping Deep Feature Space Towards Gaussian Mixture for Visual Classification

Double Gaussian Mixture Model for Image Segmentation with Spatial Relationships

Scale-invariant visual language modeling for object categorization

Hierarchical Gaussianization for Image Classification

A Novel Image Retrieval Approach With Bag-Of-Word Model And Gabor Feature

Visual Word Soft-Histogram for Image Representation

Low-dimensional Representation of Gaussian Mixture Model Supervector for Language Recognition