Abstract:Mixture models with Gamma and or inverse-Gamma distributed mixture components are useful for medical image tissue segmentation or as post-hoc models for regression coefficients obtained from linear regression within a Generalised Linear Modeling framework (GLM), used in this case to separate stochastic (Gaussian) noise from some kind of positive or negative "activation" (modeled as Gamma or inverse-Gamma distributed). To date, the most common choice in this context it is Gaussian/Gamma mixture models learned through a maximum likelihood (ML) approach; we recently extended such algorithm for mixture models with inverse-Gamma components. Here, we introduce a fully analytical Variational Bayes (VB) learning framework for both Gamma and/or inverse-Gamma components. We use synthetic and resting state fMRI data to compare the performance of the ML and VB algorithms in terms of area under the curve and computational cost. We observed that the ML Gaussian/Gamma model is very expensive specially when considering high resolution images; furthermore, these solutions are highly variable and they occasionally can overestimate the activations severely. The Bayesian Gauss-Gamma is in general the fastest algorithm but provides too dense solutions. The maximum likelihood Gaussian/inverse-Gamma is also very fast but provides in general very sparse solutions. The variational Gaussian/inverse-Gamma mixture model is the most robust and its cost is acceptable even for high resolution images. Further, the presented methodology represents an essential building block that can be directly used in more complex inference tasks, specially designed to analyse MRI-fMRI data; such models include for example analytical variational mixture models with adaptive spatial regularization or better source models for new spatial blind source separation approaches.

Memorized Variational Continual Learning for Dirichlet Process Mixtures

Sequential Learning for Dirichlet Process Mixtures

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Variational learning of hierarchical infinite generalized Dirichlet mixture models and applications

Dynamic Variational Bayesian Student's T Mixture Regression With Hidden Variables Propagation for Industrial Inferential Sensor Development

Variational Continual Bayesian Meta-Learning

Variational Hierarchical Mixtures for Probabilistic Learning of Inverse Dynamics

Oil Spill Detection in SAR Images Using Online Extended Variational Learning of Dirichlet Process Mixtures of Gamma Distributions

Association of Epstein-Barr virus with thymic carcinoma.

Dirichlet Process Mixture Model, Extensions and Applications

Learning an evolved mixture model for task-free continual learning

Efficient Mixture Learning in Black-Box Variational Inference

Learning Multi-layer Latent Variable Model via Variational Optimization of Short Run MCMC for Approximate Inference

Gradient-free variational learning with conditional mixture networks

Variational Bayes for Federated Continual Learning

Nonparametric Bayesian Methods (Dirichlet Process Mixtures)

Novel mixture allocation models for topic learning

Functional Dirichlet Process.

Variational Mixture Models with Gamma or inverse-Gamma components

Variational Inference For Nonparametric Subspace Dictionary Learning With Hierarchical Beta Process

Mixture-of-Variational-Experts for Continual Learning