Abstract:Lately, the enormous generation of databases in almost every aspect of life has created a great demand for new powerful tools for turning data into useful information. Therefore, researchers were encouraged to explore and develop new machine learning ideas and methods. Mixture models are one of the machine learning techniques receiving considerable attention due to their ability to handle efficiently and effectively multidimensional data. In this paper, we represent a solution for two challenging issues: modeling non-Gaussian data and determining the set of relevant features in the data. The problem of modeling non-Gaussian data largely present in several computer vision, image processing, medical, and Bioinformatics applications is accomplished by the development of a generative infinite Gamma mixture model. The Gamma is chosen for its ability to handle long-tailed distributions, which allows it to have a good approximation to data with outliers. The proposed model, which can be viewed as a Dirichlet process mixture of Gamma distributions, takes into account the feature selection problem by determining a set of relevant features for each data cluster which provides better interpretability and generalization capabilities. We propose then an efficient algorithm to learn this infinite model’s parameters by estimating all its posterior quantities of interest using Markov Chain Monte Carlo (MCMC) simulations. Thus, our algorithm is able to perform model selection, parameter learning, and feature selection simultaneously in a single step for the Gamma Mixture model. Furthermore, we show how the model can be used, while comparing it with other popular models in the literature, in two challenging applications namely medical images and gene expressions classification.

Variational learning of hierarchical infinite generalized Dirichlet mixture models and applications

Variational Learning for Finite Inverted Dirichlet Mixture Models and Applications

Batch and online variational learning of hierarchical Dirichlet process mixtures of multivariate Beta distributions in medical applications

Variational Hierarchical Mixtures for Probabilistic Learning of Inverse Dynamics

Memorized Variational Continual Learning for Dirichlet Process Mixtures

Clustering of non-Gaussian data by variational Bayes for normal inverse Gaussian mixture models

DIVA: A Dirichlet Process Based Incremental Deep Clustering Algorithm via Variational Auto-Encoder

Meta-learning representations for clustering with infinite Gaussian mixture models

Variational Bayesian Learning for Dirichlet Process Mixture of Inverted Dirichlet Distributions in Non-Gaussian Image Feature Modeling

Deep Variational Incomplete Multi-View Clustering: Exploring Shared Clustering Structures

Variational Information Bottleneck for Unsupervised Clustering: Deep Gaussian Mixture Embedding

Bayesian approach to clustering real value, categorical and network data: solution via variational methods

Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoders

HGMVAE: hierarchical disentanglement in Gaussian mixture variational autoencoder

Variational Graph Embedding and Clustering with Laplacian Eigenmaps

Oil Spill Detection in SAR Images Using Online Extended Variational Learning of Dirichlet Process Mixtures of Gamma Distributions

Unsupervised Clustering Through Gaussian Mixture Variational AutoEncoder with Non-Reparameterized Variational Inference and Std Annealing.

Variational Inference for Infinite Mixtures of Gaussian Processes with Applications to Traffic Flow Prediction

Variational Bayes Approximations for Clustering via Mixtures of Normal Inverse Gaussian Distributions

A hierarchical nonparametric Bayesian approach for medical images and gene expressions classification

Variational Deep Embedding: an Unsupervised and Generative Approach to Clustering.