Abstract:We establish strong inapproximability for finding the sparsest nonzero vector in a real subspace. We show that it is NP-Hard (under randomized reductions) to approximate the sparsest vector in a subspace within any constant factor (or almost polynomial factors in quasipolynomial time). We recover as a corollary state of the art inapproximability for the shortest vector problem (SVP), a foundational problem in lattice based cryptography. Our proof is surprisingly simple, bypassing even the PCP theorem. We are inspired by the homogenization framework from the inapproximability theory of minimum distance problems (MDC) in integer lattices and error correcting codes. We use a combination of (a) \emph{product testing via tensor codes} and (b) \emph{encoding an assignment as a coset of a random code in higher dimensional space} in order to embed non-homogeneous quadratic equations into the sparsest vector problem. (a) is inspired by Austrin and Khot's simplified proof of hardness of MDC over finite fields, and (b) is inspired by Micciancio's semi-derandomization of hardness of SVP. Our reduction involves the challenge of performing (a) over the reals. We prove that tensoring of the kernel of a +1/-1 random matrix furnishes an adequate product test (while still allowing (b)). The proof exposes a connection to Littlewood-Offord theory and relies on a powerful anticoncentration result of Rudelson and Vershynin. Our main motivation in this work is the development of inapproximability theory for problems over the reals. Analytic variants of sparsest vector have connections to small set expansion, quantum separability and polynomial maximization over convex sets, all of which cause similar barriers to inapproximability. The approach we develop could lead to progress on the hardness of some of these problems.

A Generalization of Varnavides's Theorem

An Open Problem on Sparse Representations in Unions of Bases

Linear equations with unknowns from a multiplicative group whose solutions lie in a small number of subspaces

The sparse parity matrix

Abundance: Asymmetric graph removal lemmas and integer solutions to linear equations

Inapproximability of Sparsest Vector in a Real Subspace

Regularity Properties for Sparse Regression

Uncommon linear systems of two equations

A Note on Sparse Solutions of Sparse Linear Systems

On a problem of Sárközy and Sós for multivariate linear forms

Code Sparsification and its Applications

Sum-of-Squares Lower Bounds for Independent Set in Ultra-Sparse Random Graphs

The sparse regularity method with Schatten norms and entropy

On the uncommonness of minimal rank-2 systems of linear equations

Spencer's theorem in nearly input-sparsity time

On Sparsity and Sub-Gaussianity in the Johnson-Lindenstrauss Lemma

Sparse Approximation in Lattices and Semigroups

The algebraic degree of sparse polynomial optimization

Variants of the Erdős distinct sums problem and variance method

Logarithmically Sparse Symmetric Matrices