Abstract:Sparse approximation is key to many signal processing, image processing, and machine learning applications. If multiple signals maintain some degree of dependency, for example, the support sets are statistically related, then it will generally be advantageous to jointly estimate the sparse representation vectors from the measurement vectors as opposed to solving for each signal individually. In this paper, we propose simultaneous sparse Bayesian learning (SBL) for joint sparse approximation with two structured sparse models (SSMs), where one is row-sparse with embedded element-sparse and the other one is row-sparse plus element-sparse. While SBL has attracted much attention as a means to deal with a single sparse approximation problem, it is not obvious how to extend SBL to SSMs. By capitalizing on a dual-space view of existing convex methods for SMs, we showcase the precision component model and covariance component model for SSMs, where both models involve a common hyperparameter and an innovation hyperparameter that together control the prior variance for each coefficient. The statistical perspective of precision component versus covariance component models unfolds the intrinsic mechanism in SSMs, and also leads to our development of SBL-inspired cost functions for SSMs. Centralized algorithms that include 11 and 12 reweighting algorithms and consensus-based decentralized algorithms are developed for simultaneous sparse approximation with SSMs. In addition, theoretical analysis is conducted to provide valuable insights into the proposed approach, which includes global minima analysis of the SBL-inspired nonconvex cost functions and convergence analysis of the proposed 11 reweighting algorithms for SSMs. Superior performance of the proposed algorithms is demonstrated by numerical experiments.

A Blocked MCC Estimator for Group Sparse System Identification

Block Sparse Recovery Via Mixed L 2 / L 1 Minimization

Joint Channel Estimation and User Grouping for Massive MIMO Systems

Block-Sparsity-Induced Adaptive Filter for Multi-Clustering System Identification

Steady-state mean-square performance analysis of the block-sparse maximum versoria criterion

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

A randomized sparse Kaczmarz solver for sparse signal recovery via minimax‐concave penalty

SPARSE KERNEL MAXIMUM MARGIN CLUSTERING

Maximum correntropy criterion based sparse adaptive filtering algorithms for robust channel estimation under non-Gaussian environments

Nonzero Degree-based Multiobjective Cooperative Coevolutionary for Block Sparse Recovery

Robust variable kernel width for maximum correntropy criterion algorithm

Group Projected Subspace Pursuit for Block Sparse Signal Reconstruction: Convergence Analysis and Applications

Toward Adaptive Robust State Estimation Based on MCC by Using the Generalized Gaussian Density As Kernel Functions

l0 Norm Constraint LMS Algorithm for Sparse System Identification.

Proportionate adaptive filtering for block-sparse system identification

Parallel Sparse Subspace Clustering Via Joint Sample and Parameter Blockwise Partition.

Joint Block-Sparse Recovery Using Simultaneous BOMP/BOLS

Proportionate Recursive Maximum Correntropy Criterion Adaptive Filtering Algorithms and their Performance Analysis

Maximum Block Energy Guided Robust Subspace Clustering

Simultaneous Bayesian Sparse Approximation with Structured Sparse Models

Fast Robust Matrix Completion via Entry-Wise ℓ0-Norm Minimization