Abstract:In this paper, we investigate the theoretical guarantees of penalized $\lun$ minimization (also called Basis Pursuit Denoising or Lasso) in terms of sparsity pattern recovery (support and sign consistency) from noisy measurements with non-necessarily random noise, when the sensing operator belongs to the Gaussian ensemble (i.e. random design matrix with i.i.d. Gaussian entries). More precisely, we derive sharp non-asymptotic bounds on the sparsity level and (minimal) signal-to-noise ratio that ensure support identification for most signals and most Gaussian sensing matrices by solving the Lasso problem with an appropriately chosen regularization parameter. Our first purpose is to establish conditions allowing exact sparsity pattern recovery when the signal is strictly sparse. Then, these conditions are extended to cover the compressible or nearly sparse case. In these two results, the role of the minimal signal-to-noise ratio is crucial. Our third main result gets rid of this assumption in the strictly sparse case, but this time, the Lasso allows only partial recovery of the support. We also provide in this case a sharp $\ell_2$-consistency result on the coefficient vector. The results of the present work have several distinctive features compared to previous ones. One of them is that the leading constants involved in all the bounds are sharp and explicit. This is illustrated by some numerical experiments where it is indeed shown that the sharp sparsity level threshold identified by our theoretical results below which sparsistency of the Lasso is guaranteed meets that empirically observed.

Sharpness and well-conditioning of nonsmooth convex formulations in statistical signal recovery

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

I T ] 8 S ep 2 01 3 Sparse Recovery with Coherent Tight Frames via Analysis Dantzig Selector and Analysis LASSO ∗

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

The Convergence Guarantees of a Non-Convex Approach for Sparse Recovery.

Robust Sparse Recovery Via Non-Convex Optimization

Low-Rank Matrix Recovery with Composite Optimization: Good Conditioning and Rapid Convergence

Computational complexity versus statistical performance on sparse recovery problems

Sharp Support Recovery from Noisy Random Measurements by L1 minimization

Noisy recovery from random linear observations: Sharp minimax rates under elliptical constraints

Fast Sparse Recovery Via Non-Convex Optimization

Sparse Recovery Conditions and Performance Bounds for $\ell _p$ -Minimization

On recovery of sparse signals via l1 minimization

Robust Sparse Recovery Via Weakly Convex Optimization in Impulsive Noise

Sparse Signal Recovery Via Minimax-Concave Penalty and ℓ 1 -Norm Loss Function.

An Efficient Semismooth Newton Method for Adaptive Sparse Signal Recovery Problems

Efficient and Robust Recovery of Sparse Signal and Image Using Generalized Nonconvex Regularization

Sharp Restricted Isometry Property Bounds for Low-rank Matrix Recovery Problems with Corrupted Measurements

Sparse Signal Recovery by Minimization Under Restricted Isometry Property

Accuracy guarantees for L1-recovery