Abstract:We present a variational Bayesian (VB) implementation of block-sparse Bayesian learning (BSBL), which approximates the posterior probability density function (PDF) of the latent variables a factorzied proxy PDFs. The prior distribution of the BSBL hyperparameters is selected to be the generalized inverse Gaussian distribution. This choice unifies commonly used hyperpriors, e.g. the Gamma distribution, inverse Gamma distribution, and Jeffrey's improper prior. The resulting variational BSBL (VA-BSBL) algorithm updates in an iterative manner the proxi PDFs of the weights and hyperparameters. The proxy PDF of the weights only depends on the proxy PDFs of the hyperparameters through the means of the latter PDFs. We adopt a scheduling of the iterations in which the proxi PDF of a single hyperparameter and the proxi PDF of the weights are cyclically updated ad infinitum. The resulting sequence of means of the hyperparameter proxi PDFs computed in this way can be expressed as a nonlinear first-order recurrence relation. Hence, the fixed points of the recurrence relation can be used for single-step check for convergence of this sequence. Including this check procedure in the VA-BSBL, we obtain a fast version of the algorithm, coined fast-BSBL (F-BSBL), which shows a two-order-of-magnitude faster runtime. Additionally, we analyse a necessary condition for the existence of fixed points and show that only certain improper generalized inverse Gaussian hyperpriors induce a sparse estimate of the weights. Finally, we generalize this equivalence to BSBL. Specifically, we show that the presented VA-BSBL is equivalent to expectation-maximization (EM)-based Type-II-BSBL. As a result, the fast versions of them, i.e. FBSBL for the former and Type-II-BSBL using coordinate ascent for the latter, are equivalent as well. This result allows for reinterpreting previous works on BSBL within our framework.

Fast Inverse-Free Generalized Sparse Bayesian Iearning Algorithm

Sparse Bayesian Learning Approach for Discrete Signal Reconstruction

An AMP-Based Low Complexity Generalized Sparse Bayesian Learning Algorithm

A Generalized Sparse Bayesian Learning Algorithm for 1-Bit DOA Estimation

Towards Inversion-Free Sparse Bayesian Learning: A Universal Approach

Fast Inverse-Free Sparse Bayesian Learning Via Relaxed Evidence Lower Bound Maximization.

Sparse Bayesian Learning with Automatic-Weighting Laplace Priors for Sparse Signal Recovery.

Sparse Bayesian Approach to Fast Learning Network for Multiclassification.

Fast and robust Block-Sparse Bayesian learning for EEG source imaging

Superresolution radar imaging based on fast inverse-free sparse Bayesian learning for multiple measurement vectors

Covariance-Free Sparse Bayesian Learning

Gohberg-Semencul Factorization-Based Fast Implementation of Sparse Bayesian Learning With a Fourier Dictionary

Fast Variational Block-Sparse Bayesian Learning

Sparse Aperture Autofocusing and Imaging Based on Fast Sparse Bayesian Learning From Gapped Data

Hyperparameter Estimation for Sparse Bayesian Learning Models

Approximating the zero-norm penalized sparse signal recovery using a hierarchical Bayesian framework

Complex Sparse Signal Recovery with Adaptive Laplace Priors

Simultaneous Bayesian Sparse Approximation with Structured Sparse Models

Generalized sparsity-promoting solvers for Bayesian inverse problems: Versatile sparsifying transforms and unknown noise variances

Sparse Reconstruction Using Block Sparse Bayesian Learning With Fast Marginalized Likelihood Maximization for Near-Infrared Spectroscopy

An efficient off-grid direction-of-arrival estimation method based on inverse-free sparse Bayesian learning