Abstract:We study the problem of obtaining efficient, deterministic, black-box polynomial identity testing algorithms for depth-3 set-multilinear circuits (over arbitrary fields). This class of circuits has an efficient, deterministic, white-box polynomial identity testing algorithm (due to Raz and Shpilka [36]), but has no known such black-box algorithm. We recast this problem as a question of finding a low-dimensional subspace H, spanned by rank 1 tensors, such that any non-zero tensor in the dual space ker(H) has high rank. We obtain explicit constructions of essentially optimal-size hitting sets for tensors of degree 2 (matrices), and obtain the first quasi-polynomial sized hitting sets for arbitrary tensors. We also show connections to the task of performing low-rank recovery of matrices, which is studied in the field of compressed sensing. Low-rank recovery asks (say, over R) to recover a matrix M from few measurements, under the promise that M is rank ≤ r. In this work, we restrict our attention to recovering matrices that are exactly rank ≤ r using deterministic, non-adaptive, linear measurements, that are free from noise. Over R, we provide a set (of size 4nr) of such measurements, from which M can be recovered in O(rn2+r3n) field operations, and the number of measurements is essentially optimal. Further, the measurements can be taken to be all rank-1 matrices, or all sparse matrices. To the best of our knowledge no explicit constructions with those properties were known prior to this work. We also give a more formal connection between low-rank recovery and the task of sparse (vector) recovery: any sparse-recovery algorithm that exactly recovers vectors of length n and sparsity 2r, using m non-adaptive measurements, yields a low-rank recovery scheme for exactly recovering n x n matrices of rank ≤ r, making 2nm non-adaptive measurements. Furthermore, if the sparse-recovery algorithm runs in time τ, then the low-rank recovery algorithm runs in time O(rn2+nτ). We obtain this reduction using linear-algebraic techniques, and not using convex optimization, which is more commonly seen in compressed sensing algorithms. Finally, we also make a connection to rank-metric codes, as studied in coding theory. These are codes with codewords consisting of matrices (or tensors) where the distance of matrices M and N is rank(M-N), as opposed to the usual hamming metric. We obtain essentially optimal-rate codes over matrices, and provide an efficient decoding algorithm. We obtain codes over tensors as well, with poorer rate, but still with efficient decoding.

Convex recovery of tensors using nuclear norm penalization

Tensor Recovery via Nonconvex Low-Rank Approximation

Efficiency of First-Order Methods for Low-Rank Tensor Recovery with the Tensor Nuclear Norm Under Strict Complementarity

On The Synergy Between Nonconvex Extensions of The Tensor Nuclear Norm for Tensor Recovery

Tensor recovery using the tensor nuclear norm based on nonconvex and nonlinear transformations

Robust Low-Rank Tensor Recovery Via Nonconvex Singular Value Minimization.

A Scale-Invariant Relaxation in Low-Rank Tensor Recovery with an Application to Tensor Completion

Tensor N-tubal rank and its convex relaxation for low-rank tensor recovery

Exact Low Tubal Rank Tensor Recovery from Gaussian Measurements

An L1-L2 Variant of Tubal Nuclear Norm for Guaranteed Tensor Recovery

Robust low tubal rank tensor recovery via L 2 E criterion

Robust Recovery of Low-Rank Matrices Via Non-Convex Optimization

Tensor Robust Principal Component Analysis with a New Tensor Nuclear Norm

On the subdifferential of symmetric convex functions of the spectrum for symmetric and orthogonally decomposable tensors

A Survey on Nonconvex Regularization Based Sparse and Low-Rank Recovery in Signal Processing, Statistics, and Machine Learning

Robust tensor recovery with nonconvex and nonsmooth regularization

Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimization

Multi-dimensional Imaging Data Recovery Via Minimizing the Partial Sum of Tubal Nuclear Norm

Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm Regularization

On identity testing of tensors, low-rank recovery and compressed sensing

Low-n-rank tensor recovery based on multi-linear augmented Lagrange multiplier method