Abstract:We establish strong inapproximability for finding the sparsest nonzero vector in a real subspace. We show that it is NP-Hard (under randomized reductions) to approximate the sparsest vector in a subspace within any constant factor (or almost polynomial factors in quasipolynomial time). We recover as a corollary state of the art inapproximability for the shortest vector problem (SVP), a foundational problem in lattice based cryptography. Our proof is surprisingly simple, bypassing even the PCP theorem. We are inspired by the homogenization framework from the inapproximability theory of minimum distance problems (MDC) in integer lattices and error correcting codes. We use a combination of (a) \emph{product testing via tensor codes} and (b) \emph{encoding an assignment as a coset of a random code in higher dimensional space} in order to embed non-homogeneous quadratic equations into the sparsest vector problem. (a) is inspired by Austrin and Khot's simplified proof of hardness of MDC over finite fields, and (b) is inspired by Micciancio's semi-derandomization of hardness of SVP. Our reduction involves the challenge of performing (a) over the reals. We prove that tensoring of the kernel of a +1/-1 random matrix furnishes an adequate product test (while still allowing (b)). The proof exposes a connection to Littlewood-Offord theory and relies on a powerful anticoncentration result of Rudelson and Vershynin. Our main motivation in this work is the development of inapproximability theory for problems over the reals. Analytic variants of sparsest vector have connections to small set expansion, quantum separability and polynomial maximization over convex sets, all of which cause similar barriers to inapproximability. The approach we develop could lead to progress on the hardness of some of these problems.

Noncommutative Donoho-Elad-Gribonval-Nielsen-Fuchs Sparsity Theorem

An Open Problem on Sparse Representations in Unions of Bases

New Bounds for Restricted Isometry Constants with Coherent Tight Frames

A Proof of Conjecture on Restricted Isometry Property Constants $\delta _{tk}\ \left(0<t<\frac {4}{3}\Right)$

Sparse Recovery with Coherent Tight Frame via Analysis Dantzig Selector and Analysis LASSO

I T ] 8 S ep 2 01 3 Sparse Recovery with Coherent Tight Frames via Analysis Dantzig Selector and Analysis LASSO ∗

On the Null Space Constant for ${\ell _p}$ Minimization

On NP-Hardness of $L_1/L_2$ Minimization and Bound Theory of Nonzero Entries in Solutions

Inapproximability of Sparsest Vector in a Real Subspace

Noncommutative Donoho-Stark-Elad-Bruckstein-Ricaud-Torrésani Uncertainty Principle

Optimally Sparse Frames

Spencer's theorem in nearly input-sparsity time

On the Null Space Constant for <formula Formulatype="inline"><tex Notation="TeX">${\ell _p}$</tex></formula> Minimization

Functional Donoho-Stark-Elad-Bruckstein-Ricaud-Torrésani Uncertainty Principle

Optimality of $\ell_2/\ell_1$-optimization block-length dependent thresholds

Noisy matrix decomposition via convex relaxation: Optimal rates in high dimensions

On unified view of nullspace-type conditions for recoveries associated with general sparsity structures

Near-Optimal Time-Sparsity Trade-Offs for Solving Noisy Linear Equations

Robustness of Sparse Recovery Via &Lt;inline-Formula> &Lt;tex-Math Notation="latex">$f$ &Lt;/tex-Math></inline-formula>-minimization: A Topological Viewpoint

Computing sparse Fourier sum of squares on finite abelian groups in quasi-linear time