Abstract:Sparse approximation is key to many signal processing, image processing, and machine learning applications. If multiple signals maintain some degree of dependency, for example, the support sets are statistically related, then it will generally be advantageous to jointly estimate the sparse representation vectors from the measurement vectors as opposed to solving for each signal individually. In this paper, we propose simultaneous sparse Bayesian learning (SBL) for joint sparse approximation with two structured sparse models (SSMs), where one is row-sparse with embedded element-sparse and the other one is row-sparse plus element-sparse. While SBL has attracted much attention as a means to deal with a single sparse approximation problem, it is not obvious how to extend SBL to SSMs. By capitalizing on a dual-space view of existing convex methods for SMs, we showcase the precision component model and covariance component model for SSMs, where both models involve a common hyperparameter and an innovation hyperparameter that together control the prior variance for each coefficient. The statistical perspective of precision component versus covariance component models unfolds the intrinsic mechanism in SSMs, and also leads to our development of SBL-inspired cost functions for SSMs. Centralized algorithms that include 11 and 12 reweighting algorithms and consensus-based decentralized algorithms are developed for simultaneous sparse approximation with SSMs. In addition, theoretical analysis is conducted to provide valuable insights into the proposed approach, which includes global minima analysis of the SBL-inspired nonconvex cost functions and convergence analysis of the proposed 11 reweighting algorithms for SSMs. Superior performance of the proposed algorithms is demonstrated by numerical experiments.

Hyperparameter Estimation for Sparse Bayesian Learning Models

Hyperparameter Estimation for Sparse Bayesian Learning Models

Unitary Approximate Message Passing for Sparse Bayesian Learning

An AMP-Based Low Complexity Generalized Sparse Bayesian Learning Algorithm

Sparse Bayesian Learning Approach for Discrete Signal Reconstruction

Fast Inverse-Free Generalized Sparse Bayesian Iearning Algorithm

Simultaneous Bayesian Sparse Approximation with Structured Sparse Models

Sparse Estimation using Bayesian Hierarchical Prior Modeling for Real and Complex Linear Models

Sparse Bayesian Learning with Automatic-Weighting Laplace Priors for Sparse Signal Recovery.

Sparse Bayesian learning with uncertainty models and multiple dictionaries

On The Sparse Bayesian Learning Of Linear Models

Group sparse Bayesian learning via exact and fast marginal likelihood maximization

Leveraging Joint Sparsity in Hierarchical Bayesian Learning

Hyper-Parameter Auto-Tuning for Sparse Bayesian Learning

Generalized sparsity-promoting solvers for Bayesian inverse problems: Versatile sparsifying transforms and unknown noise variances

Approximating the zero-norm penalized sparse signal recovery using a hierarchical Bayesian framework

Towards Inversion-Free Sparse Bayesian Learning: A Universal Approach

Sparse Bayesian Learning Based on an Efficient Subset Selection

Covariance-Free Sparse Bayesian Learning

Computationally Efficient Sampling Methods for Sparsity Promoting Hierarchical Bayesian Models

Sparse Bayesian Learning Based on Collaborative Neurodynamic Optimization