Abstract:In the subspace sketch problem one is given an $n\times d$ matrix $A$ with $O(\log(nd))$ bit entries, and would like to compress it in an arbitrary way to build a small space data structure $Q_p$, so that for any given $x \in \mathbb{R}^d$, with probability at least $2/3$, one has $Q_p(x)=(1\pm\epsilon)\|Ax\|_p$, where $p\geq 0$, and where the randomness is over the construction of $Q_p$. The central question is: How many bits are necessary to store $Q_p$? This problem has applications to the communication of approximating the number of non-zeros in a matrix product, the size of coresets in projective clustering, the memory of streaming algorithms for regression in the row-update model, and embedding subspaces of $L_p$ in functional analysis. A major open question is the dependence on the approximation factor $\epsilon$. We show if $p\geq 0$ is not a positive even integer and $d=\Omega(\log(1/\epsilon))$, then $\tilde{\Omega}(\epsilon^{-2}d)$ bits are necessary. On the other hand, if $p$ is a positive even integer, then there is an upper bound of $O(d^p\log(nd))$ bits independent of $\epsilon$. Our results are optimal up to logarithmic factors, and show in particular that one cannot compress $A$ to $O(d)$ "directions" $v_1,\dots,v_{O(d)}$, such that for any $x$, $\|Ax\|_1$ can be well-approximated from $\langle v_1,x\rangle,\dots,\langle v_{O(d)},x\rangle$. Our lower bound rules out arbitrary functions of these inner products (and in fact arbitrary data structures built from $A$), and thus rules out the possibility of a singular value decomposition for $\ell_1$ in a very strong sense. Indeed, as $\epsilon\to 0$, for $p = 1$ the space complexity becomes arbitrarily large, while for $p = 2$ it is at most $O(d^2 \log(nd))$. As corollaries of our main lower bound, we obtain new lower bounds for a wide range of applications, including the above, which in many cases are optimal.

Upper bounds and spectrum for approximation exponents for subspaces of $\mathbb{R}^n$

Independence of the Diophantine exponents associated with linear subspaces

Approximation de sous-espaces vectoriels de $\mathbb{R}^n$ par des sous-espaces rationnels

Construction of subspaces with known Diophantine exponents for the last angle

Best approximation vectors for completely irrational subspaces

LIL and the Approximation of Rectangular Sums of B-valued Random Variables when Extreme Terms Are Excluded

Probabilistic Effectivity in the Subspace Theorem

Angles Between Infinite Dimensional Subspaces with Applications to the Rayleigh-Ritz and Alternating Projectors Methods

Geometric and arithmetic aspects of approximation vectors

Bounds on Hilbert functions with application to convexity

Diophantine approximation in metric space

Approximation in the Zygmund and Hölder classes on $\mathbb{R}^n$

Dimension of Diophantine approximation and applications

Tight Bounds for the Subspace Sketch Problem with Applications

Uniform Diophantine approximation with restricted denominators

Probabilistic bounds on best rank-1 approximation ratio

Inhomogeneous Diophantine Approximation on $M_0$-sets

Block subspace expansions for eigenvalues and eigenvectors approximation

A further improvement of the quantitative Subspace Theorem

An upper bound of the Hausdorff dimension of singular vectors on affine subspaces

On simultaneous approximation to a real number, its square, and its cube, II