Abstract:We study the problem of obtaining efficient, deterministic, black-box polynomial identity testing algorithms for depth-3 set-multilinear circuits (over arbitrary fields). This class of circuits has an efficient, deterministic, white-box polynomial identity testing algorithm (due to Raz and Shpilka [36]), but has no known such black-box algorithm. We recast this problem as a question of finding a low-dimensional subspace H, spanned by rank 1 tensors, such that any non-zero tensor in the dual space ker(H) has high rank. We obtain explicit constructions of essentially optimal-size hitting sets for tensors of degree 2 (matrices), and obtain the first quasi-polynomial sized hitting sets for arbitrary tensors. We also show connections to the task of performing low-rank recovery of matrices, which is studied in the field of compressed sensing. Low-rank recovery asks (say, over R) to recover a matrix M from few measurements, under the promise that M is rank ≤ r. In this work, we restrict our attention to recovering matrices that are exactly rank ≤ r using deterministic, non-adaptive, linear measurements, that are free from noise. Over R, we provide a set (of size 4nr) of such measurements, from which M can be recovered in O(rn2+r3n) field operations, and the number of measurements is essentially optimal. Further, the measurements can be taken to be all rank-1 matrices, or all sparse matrices. To the best of our knowledge no explicit constructions with those properties were known prior to this work. We also give a more formal connection between low-rank recovery and the task of sparse (vector) recovery: any sparse-recovery algorithm that exactly recovers vectors of length n and sparsity 2r, using m non-adaptive measurements, yields a low-rank recovery scheme for exactly recovering n x n matrices of rank ≤ r, making 2nm non-adaptive measurements. Furthermore, if the sparse-recovery algorithm runs in time τ, then the low-rank recovery algorithm runs in time O(rn2+nτ). We obtain this reduction using linear-algebraic techniques, and not using convex optimization, which is more commonly seen in compressed sensing algorithms. Finally, we also make a connection to rank-metric codes, as studied in coding theory. These are codes with codewords consisting of matrices (or tensors) where the distance of matrices M and N is rank(M-N), as opposed to the usual hamming metric. We obtain essentially optimal-rate codes over matrices, and provide an efficient decoding algorithm. We obtain codes over tensors as well, with poorer rate, but still with efficient decoding.

On Matrix Multiplication and Polynomial Identity Testing

Polynomial Identity Testing via Evaluation of Rational Functions

Randomized Black-Box PIT for Small Depth +-Regular Non-commutative Circuits

Identity Testing for +-Regular Noncommutative Arithmetic Circuits

Witnessing Matrix Identities and Proof Complexity

Generating Matrix Identities and Proof Complexity Lower Bounds.

Near-optimal Bootstrapping of Hitting Sets for Algebraic Models

Arithmetic Circuit Lower Bounds via MaxRank

Generating Matrix Identities and Hard Instances for Strong Proof Systems

On some matrix counting problems

Feasibly Constructive Proof of Schwartz-Zippel Lemma and the Complexity of Finding Hitting Sets

Lower Bounds for Arithmetic Circuits via the Hankel Matrix

Subexponential Size Hitting Sets for Bounded Depth Multilinear Formulas

Small hitting-sets for tiny arithmetic circuits or: How to turn bad designs into good

Deterministic identity testing paradigms for bounded top-fanin depth-4 circuits

Nondeterministic Quasi-Polynomial Time is Average-Case Hard for [math] Circuits

Norm of matrix-valued polynomials in random unitaries and permutations

Progress on Polynomial Identity Testing - II

Matrix Multiplication Verification Using Coding Theory

Integer matrices with a given characteristic polynomial and multiplicative dependence of matrices

On identity testing of tensors, low-rank recovery and compressed sensing