Abstract:In the subspace sketch problem one is given an $n\times d$ matrix $A$ with $O(\log(nd))$ bit entries, and would like to compress it in an arbitrary way to build a small space data structure $Q_p$, so that for any given $x \in \mathbb{R}^d$, with probability at least $2/3$, one has $Q_p(x)=(1\pm\epsilon)\|Ax\|_p$, where $p\geq 0$, and where the randomness is over the construction of $Q_p$. The central question is: How many bits are necessary to store $Q_p$? This problem has applications to the communication of approximating the number of non-zeros in a matrix product, the size of coresets in projective clustering, the memory of streaming algorithms for regression in the row-update model, and embedding subspaces of $L_p$ in functional analysis. A major open question is the dependence on the approximation factor $\epsilon$. We show if $p\geq 0$ is not a positive even integer and $d=\Omega(\log(1/\epsilon))$, then $\tilde{\Omega}(\epsilon^{-2}d)$ bits are necessary. On the other hand, if $p$ is a positive even integer, then there is an upper bound of $O(d^p\log(nd))$ bits independent of $\epsilon$. Our results are optimal up to logarithmic factors, and show in particular that one cannot compress $A$ to $O(d)$ "directions" $v_1,\dots,v_{O(d)}$, such that for any $x$, $\|Ax\|_1$ can be well-approximated from $\langle v_1,x\rangle,\dots,\langle v_{O(d)},x\rangle$. Our lower bound rules out arbitrary functions of these inner products (and in fact arbitrary data structures built from $A$), and thus rules out the possibility of a singular value decomposition for $\ell_1$ in a very strong sense. Indeed, as $\epsilon\to 0$, for $p = 1$ the space complexity becomes arbitrarily large, while for $p = 2$ it is at most $O(d^2 \log(nd))$. As corollaries of our main lower bound, we obtain new lower bounds for a wide range of applications, including the above, which in many cases are optimal.

Subspace Designs Based on Algebraic Function Fields

New Constructions of Large Cyclic Subspace Codes and Sidon Spaces.

On subspace designs

Lossless Dimension Expanders Via Linearized Polynomials and Subspace Designs

Designs in finite classical polar spaces

Explicit List-Decodable Rank-Metric and Subspace Codes Via Subspace Designs.

New constructions of cyclic subspace codes

New constructions of constant dimension subspace codes with large sizes

Bounds on Subspace Codes Based on Totally Isotropic Subspaces in Unitary Spaces.

Constructions and bounds for subspace codes

Bounds On Subspace Codes Based On Orthogonal Space Over Finite Fields Of Characteristic 2

Tight Bounds for the Subspace Sketch Problem with Applications

Bounds on Subspace Codes Based on Subspaces of Type (m, 1) in Singular Linear Space

Subspace Code Based on Flats in Affine Space over Finite Fields.

Subspace Codes Based on Partial Injective Maps of Vector Spaces over Finite Fields.

Variety Evasive Subspace Families

A New Class of Orthogonal Designs with Good Low Dimensional Space-Filling Properties

Construction of Marginally Coupled Designs by Subspace Theory

High-dimensional expanders from Kac--Moody--Steinberg groups

Constructions of -Designs from Orthogonal Geometry over Finite Fields.