Abstract:The non-negative solution to an underdetermined linear system can be uniquely recovered sometimes, even without imposing any additional sparsity constraints. In this paper, we derive conditions under which a unique non-negative solution for such a system can exist, based on the theory of polytopes. Furthermore, we develop the paradigm of combined sparse representations, where only a part of the coefficient vector is constrained to be non-negative, and the rest is unconstrained (general). We analyze the recovery of the unique, sparsest solution, for combined representations, under three different cases of coefficient support knowledge: (a) the non-zero supports of non-negative and general coefficients are known, (b) the non-zero support of general coefficients alone is known, and (c) both the non-zero supports are unknown. For case (c), we propose the combined orthogonal matching pursuit algorithm for coefficient recovery and derive the deterministic sparsity threshold under which recovery of the unique, sparsest coefficient vector is possible. We quantify the order complexity of the algorithms, and examine their performance in exact and approximate recovery of coefficients under various conditions of noise. Furthermore, we also obtain their empirical phase transition characteristics. We show that the basis pursuit algorithm, with partial non-negative constraints, and the proposed greedy algorithm perform better in recovering the unique sparse representation when compared to their unconstrained counterparts. Finally, we demonstrate the utility of the proposed methods in recovering images corrupted by saturation noise.

A Bilinear Algorithm for Sparse Representations

Optimization Algorithms for Sparse Representations and Applications

Sparse Bayesian Learning Approach for Discrete Signal Reconstruction

Sparse Component Analysis and Blind Source Separation of Underdetermined Mixtures

Robust Sparse Recovery with Sparse Bernoulli matrices via Expanders

A fast semi-direct least squares algorithm for hierarchically block separable matrices

An Efficient Gauss--Newton Algorithm for Symmetric Low-Rank Product Matrix Approximations

A Subspace Clustering Algorithm Based on Simultaneously Sparse and Low-Rank Representation

Graph Sparsification by Approximate Matrix Multiplication

A Fast Algorithm for Sparse Reconstruction Based on Shrinkage, Subspace Optimization, and Continuation

Split Bregman Algorithms for Block-Sparse Reconstruction

A Matrix Hyperbolic Cosine Algorithm and Applications

Multi-view low-rank sparse subspace clustering

Fast and Robust Sparsity-Aware Block Diagonal Representation

Bayesian Algorithms for Kronecker-structured Sparse Vector Recovery With Application to IRS-MIMO Channel Estimation

Orthogonal Projective Sparse Coding for Image Representation

Recovering Non-negative and Combined Sparse Representations

An Efficient Two-Stage Sparse Representation Method.

L0-norm Sparse Graph-regularized SVD for Biclustering

Rank–sparsity Balanced Representation for Subspace Clustering

BSIK-SVD: A dictionary-learning algorithm for block-sparse representations