Abstract:We present a variational Bayesian (VB) implementation of block-sparse Bayesian learning (BSBL), which approximates the posterior probability density function (PDF) of the latent variables a factorzied proxy PDFs. The prior distribution of the BSBL hyperparameters is selected to be the generalized inverse Gaussian distribution. This choice unifies commonly used hyperpriors, e.g. the Gamma distribution, inverse Gamma distribution, and Jeffrey's improper prior. The resulting variational BSBL (VA-BSBL) algorithm updates in an iterative manner the proxi PDFs of the weights and hyperparameters. The proxy PDF of the weights only depends on the proxy PDFs of the hyperparameters through the means of the latter PDFs. We adopt a scheduling of the iterations in which the proxi PDF of a single hyperparameter and the proxi PDF of the weights are cyclically updated ad infinitum. The resulting sequence of means of the hyperparameter proxi PDFs computed in this way can be expressed as a nonlinear first-order recurrence relation. Hence, the fixed points of the recurrence relation can be used for single-step check for convergence of this sequence. Including this check procedure in the VA-BSBL, we obtain a fast version of the algorithm, coined fast-BSBL (F-BSBL), which shows a two-order-of-magnitude faster runtime. Additionally, we analyse a necessary condition for the existence of fixed points and show that only certain improper generalized inverse Gaussian hyperpriors induce a sparse estimate of the weights. Finally, we generalize this equivalence to BSBL. Specifically, we show that the presented VA-BSBL is equivalent to expectation-maximization (EM)-based Type-II-BSBL. As a result, the fast versions of them, i.e. FBSBL for the former and Type-II-BSBL using coordinate ascent for the latter, are equivalent as well. This result allows for reinterpreting previous works on BSBL within our framework.

Alternative to Extended Block Sparse Bayesian Learning and Its Relation to Pattern-Coupled Sparse Bayesian Learning.

Block-Sparse Signal Recovery Based on Adaptive Matching Pursuit Via Spike and Slab Prior

Sparse Bayesian Learning Using Correlated Hyperparameters for Recovery of Block Sparse Signals.

Approximate Message Passing with Nearest Neighbor Sparsity Pattern Learning

Sparse Bayesian Learning Approach for Discrete Signal Reconstruction

Extension of SBL Algorithms for the Recovery of Block Sparse Signals With Intra-Block Correlation

Block Sparse Bayesian Learning: A Diversified Scheme

Fast Inverse-Free Generalized Sparse Bayesian Iearning Algorithm

A Multilayer Joint Regularized Block Sparse Bayesian Algorithm With Space–Time Structured Prior Learning Function

A Noise-Aware Real-Time Processing Approach for Electroencephalogram Signal Classification

Simultaneous Block-Sparse Signal Recovery Using Pattern-Coupled Sparse Bayesian Learning

Block Sparse Recovery Via Mixed L 2 / L 1 Minimization

Block-Sparse Signal Recovery via General Total Variation Regularized Sparse Bayesian Learning

Priori-block Sparse Bayesian Learning Algorithm for Compressed Sensing Based ECG Recovery

Block Sparse Bayesian Recovery with Correlated LSM Prior

Sound field reconstruction using sparse Bayesian learning equivalent source method with hyperparametric-coupled prior

Adaptive Pattern-Coupled Sparse Bayesian Learning for Channel Estimation in OTFS Systems

Exploiting Prior Information in Block Sparse Signals

Iterative Bayesian Reconstruction of Non-IID Block-Sparse Signals

Fast Variational Block-Sparse Bayesian Learning

Simultaneous Bayesian Sparse Approximation with Structured Sparse Models