Abstract:The sparse structure of the solution for an inverse problem can be modelled using different sparsity enforcing priors when the Bayesian approach is considered. Analytical expression for the unknowns of the model can be obtained by building hierarchical models based on sparsity enforcing distributions expressed via conjugate priors. We consider heavy tailed distributions with this property: the Student-t distribution, which is expressed as a Normal scale mixture, with the mixing distribution the Inverse Gamma distribution, the Laplace distribution, which can also be expressed as a Normal scale mixture, with the mixing distribution the Exponential distribution or can be expressed as a Normal inverse scale mixture, with the mixing distribution the Inverse Gamma distribution, the Hyperbolic distribution, the Variance-Gamma distribution, the Normal-Inverse Gaussian distribution, all three expressed via conjugate distributions using the Generalized Hyperbolic distribution. For all distributions iterative algorithms are derived based on hierarchical models that account for the uncertainties of the forward model. For estimation, Maximum A Posterior (MAP) and Posterior Mean (PM) via variational Bayesian approximation (VBA) are used. The performances of resulting algorithm are compared in applications in 3D computed tomography (3D-CT) and chronobiology. Finally, a theoretical study is developed for comparison between sparsity enforcing algorithms obtained via the Bayesian approach and the sparsity enforcing algorithms issued from regularization techniques, like LASSO and some others.

Sparse reconstructions from few noisy data: analysis of hierarchical Bayesian models with generalized gamma hyperpriors

Sparsity promoting hybrid solvers for hierarchical Bayesian inverse problems

Generalized sparsity-promoting solvers for Bayesian inverse problems: Versatile sparsifying transforms and unknown noise variances

Hierarchical Ensemble Kalman Methods with Sparsity-Promoting Generalized Gamma Hyperpriors

Computationally Efficient Sampling Methods for Sparsity Promoting Hierarchical Bayesian Models

Fast Bayesian hierarchical inference via sparsity enforcing a priori for aeroacoustic source imaging

Sparsity enforcing priors in inverse problems via Normal variance mixtures: model selection, algorithms and applications

Sparse Bayesian Learning Approach for Discrete Signal Reconstruction

Leveraging Joint Sparsity in Hierarchical Bayesian Learning

The Inverse Gamma-Gamma Prior for Optimal Posterior Contraction and Multiple Hypothesis Testing

Hierarchical Sparse Coding from a Bayesian Perspective.

Bayesian High-dimensional Linear Regression with Sparse Projection-posterior

Sparse bayesian inference with regularized gaussian distributions

Maximum a posteriori estimation in graphical models using local linear approximation

Bayesian Sparse Estimation Using Double Lomax Priors

Learning a Gaussian Mixture for Sparsity Regularization in Inverse Problems

EP-GIG Priors and Applications in Bayesian Sparse Learning

Bayesian Sparse Hierarchical Model for Image Denoising.

Variational Inference and Sparsity in High-Dimensional Deep Gaussian Mixture Models

Empirical Bayes inference in sparse high-dimensional generalized linear models