Abstract:Mixture models with Gamma and or inverse-Gamma distributed mixture components are useful for medical image tissue segmentation or as post-hoc models for regression coefficients obtained from linear regression within a Generalised Linear Modeling framework (GLM), used in this case to separate stochastic (Gaussian) noise from some kind of positive or negative "activation" (modeled as Gamma or inverse-Gamma distributed). To date, the most common choice in this context it is Gaussian/Gamma mixture models learned through a maximum likelihood (ML) approach; we recently extended such algorithm for mixture models with inverse-Gamma components. Here, we introduce a fully analytical Variational Bayes (VB) learning framework for both Gamma and/or inverse-Gamma components. We use synthetic and resting state fMRI data to compare the performance of the ML and VB algorithms in terms of area under the curve and computational cost. We observed that the ML Gaussian/Gamma model is very expensive specially when considering high resolution images; furthermore, these solutions are highly variable and they occasionally can overestimate the activations severely. The Bayesian Gauss-Gamma is in general the fastest algorithm but provides too dense solutions. The maximum likelihood Gaussian/inverse-Gamma is also very fast but provides in general very sparse solutions. The variational Gaussian/inverse-Gamma mixture model is the most robust and its cost is acceptable even for high resolution images. Further, the presented methodology represents an essential building block that can be directly used in more complex inference tasks, specially designed to analyse MRI-fMRI data; such models include for example analytical variational mixture models with adaptive spatial regularization or better source models for new spatial blind source separation approaches.

Expectation propagation learning of finite and infinite Gamma mixture models and its applications

Bayesian estimation and prediction for certain mixtures

Extended Variational Inference for Gamma Mixture Model in Positive Vectors Modeling

The Infinite Student'S T-Mixture For Robust Modeling

Variational Learning for Finite Beta-Liouville Mixture Models and Its Application

A hierarchical nonparametric Bayesian approach for medical images and gene expressions classification

Probabilistic Inference from Arbitrary Uncertainty using Mixtures of Factorized Generalized Gaussians

An efficient approach to learning inhomogeneous gibbs model

A Novel Incremental Gaussian Mixture Regression and Its Application for Time-varying Multimodal Process Quality Prediction

Variational Mixture Models with Gamma or inverse-Gamma components

Oil Spill Detection in SAR Images Using Online Extended Variational Learning of Dirichlet Process Mixtures of Gamma Distributions

Learning Mixtures of Gaussians Using Diffusion Models

Big Learning Expectation Maximization

Variational learning of hierarchical infinite generalized Dirichlet mixture models and applications

Infinite mixtures of multivariate Gaussian processes

Generalizing Expectation Propagation with Mixtures of Exponential Family Distributions and an Application to Bayesian Logistic Regression.

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

A new hybrid discriminative/generative model using the full-covariance multivariate generalized Gaussian mixture models

Learning-based Gaussian Mixture Reduction for Distributed Bayesian Filter.

MAP approximation to the variational Bayes Gaussian mixture model and application

Entropic Matching for Expectation Propagation of Markov Jump Processes