Abstract:Lately, the enormous generation of databases in almost every aspect of life has created a great demand for new powerful tools for turning data into useful information. Therefore, researchers were encouraged to explore and develop new machine learning ideas and methods. Mixture models are one of the machine learning techniques receiving considerable attention due to their ability to handle efficiently and effectively multidimensional data. In this paper, we represent a solution for two challenging issues: modeling non-Gaussian data and determining the set of relevant features in the data. The problem of modeling non-Gaussian data largely present in several computer vision, image processing, medical, and Bioinformatics applications is accomplished by the development of a generative infinite Gamma mixture model. The Gamma is chosen for its ability to handle long-tailed distributions, which allows it to have a good approximation to data with outliers. The proposed model, which can be viewed as a Dirichlet process mixture of Gamma distributions, takes into account the feature selection problem by determining a set of relevant features for each data cluster which provides better interpretability and generalization capabilities. We propose then an efficient algorithm to learn this infinite model’s parameters by estimating all its posterior quantities of interest using Markov Chain Monte Carlo (MCMC) simulations. Thus, our algorithm is able to perform model selection, parameter learning, and feature selection simultaneously in a single step for the Gamma Mixture model. Furthermore, we show how the model can be used, while comparing it with other popular models in the literature, in two challenging applications namely medical images and gene expressions classification.

A new hybrid discriminative/generative model using the full-covariance multivariate generalized Gaussian mixture models

New Linear Discriminant Analysis Based on Gaussian Mixture Model

Boosting Gaussian Mixture Models Via Discriminant Analysis

A Hybrid of Generative and Discriminative Models Based on the Gaussian-coupled Softmax Layer

A New Gaussian Mixture Model Optimization Method

Speech Emotion Recognition Using Hybrid Generative and Discriminative Models

Multimodal Adversarially Learned Inference with Factorized Discriminators

Discriminative structure selection method of Gaussian Mixture Models with its application to handwritten digit recognition

A Hybrid Model Combining Learning Distance Metric and DAG Support Vector Machine for Multimodal Biometric Recognition

Discriminative Multi-Modal Deep Generative Models

Hybrid Generative-Discriminative Classification Using Posterior Divergence

Mixed data Deep Gaussian Mixture Model: A clustering model for mixed datasets

A hierarchical nonparametric Bayesian approach for medical images and gene expressions classification

Discriminant Gaborfaces and Support Vector Machines Classifier for Face Recognition

The Supervised Learning Gaussian Mixture Model

Gaussian mixture model with an extended ultrametric covariance structure

Improving model choice in classification: an approach based on clustering of covariance matrices

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

Gaussian mixture model training method based on genetic algorithms and fuzzy approach

Handwritten Character Recognition Using Semi-tied Full Covariance Gaussian Mixture Model

Hybrid Generative/Discriminative Learning for Automatic Image Annotation