Abstract:In this paper, we investigate the recovery of the sparse representation of data in general infinite-dimensional optimization problems regularized by convex functionals. We show that it is possible to define a suitable non-degeneracy condition on the minimal-norm dual certificate, extending the well-established non-degeneracy source condition (NDSC) associated with total variation regularized problems in the space of measures, as introduced in (Duval and Peyré, FoCM, 15:1315-1355, 2015). In our general setting, we need to study how the dual certificate is acting, through the duality product, on the set of extreme points of the ball of the regularizer, seen as a metric space. This justifies the name Metric Non-Degenerate Source Condition (MNDSC). More precisely, we impose a second-order condition on the dual certificate, evaluated on curves with values in small neighbourhoods of a given collection of n extreme points. By assuming the validity of the MNDSC, together with the linear independence of the measurements on these extreme points, we establish that, for a suitable choice of regularization parameters and noise levels, the minimizer of the minimization problem is unique and is uniquely represented as a linear combination of n extreme points. The paper concludes by obtaining explicit formulations of the MNDSC for three problems of interest. First, we examine total variation regularized deconvolution problems, showing that the classical NDSC implies our MNDSC, and recovering a result similar to (Duval and Peyré, FoCM, 15:1315-1355, 2015). Then, we consider 1-dimensional BV functions regularized with their BV-seminorm and pairs of measures regularized with their mutual 1-Wasserstein distance. In each case, we provide explicit versions of the MNDSC and formulate specific sparse representation recovery results.

Near-Optimal Recovery of Linear and N-Convex Functions on Unions of Convex Sets

Near-Optimal Estimation of Linear Functionals with Log-Concave Observation Errors

Sharpness and well-conditioning of nonsmooth convex formulations in statistical signal recovery

Optimal Recovery of a Family of Operators from Inaccurate Measurements on a Compact Set

Towards optimal algorithms for the recovery of low-dimensional models with linear rates

On Robust Recovery of Signals from Indirect Observations

Stable Outlier-Robust Signal Recovery Over Networks: A Convex Analytic Approach Using Minimax Concave Loss

Near Optimal Stochastic Algorithms for Finite-Sum Unbalanced Convex-Concave Minimax Optimization

A General Theory for Exact Sparse Representation Recovery in Convex Optimization

Radius of Information for Two Intersected Centered Hyperellipsoids and Implications in Optimal Recovery from Inaccurate Data

Convex recovery of a structured signal from independent random linear measurements

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

Noisy recovery from random linear observations: Sharp minimax rates under elliptical constraints

Instances of Computational Optimal Recovery: Dealing with Observation Errors

Robust Sparse Recovery Via Non-Convex Optimization

Full Recovery from Point Values: an Optimal Algorithm for Chebyshev Approximability Prior

A Fast Convex Conjugated Algorithm for Sparse Recovery

The Convergence Guarantees of a Non-Convex Approach for Sparse Recovery.

Robust Sparse Recovery Via Weakly Convex Optimization in Impulsive Noise

Robust Recovery of Low-Rank Matrices Via Non-Convex Optimization

On the Optimal Recovery of One Family of Operators on a Class of Functions from Approximate Information about Its Spectrum