Abstract:We study lower bounds on adaptive sensing algorithms for recovering low rank matrices using linear measurements. Given an $n \times n$ matrix $A$, a general linear measurement $S(A)$, for an $n \times n$ matrix $S$, is just the inner product of $S$ and $A$, each treated as $n^2$-dimensional vectors. By performing as few linear measurements as possible on a rank-$r$ matrix $A$, we hope to construct a matrix $\hat{A}$ that satisfies $\|A - \hat{A}\|_F^2 \le c\|A\|_F^2$, for a small constant $c$. It is commonly assumed that when measuring $A$ with $S$, the response is corrupted with an independent Gaussian random variable of mean $0$ and variance $\sigma^2$. Candés and Plan study non-adaptive algorithms for low rank matrix recovery using random linear measurements. At a certain noise level, it is known that their non-adaptive algorithms need to perform $\Omega(n^2)$ measurements, which amounts to reading the entire matrix. An important question is whether adaptivity helps in decreasing the overall number of measurements. We show that any adaptive algorithm that uses $k$ linear measurements in each round and outputs an approximation to the underlying matrix with probability $\ge 9/10$ must run for $t = \Omega(\log(n^2/k)/\log\log n)$ rounds showing that any adaptive algorithm which uses $n^{2-\beta}$ linear measurements in each round must run for $\Omega(\log n/\log\log n)$ rounds to compute a reconstruction with probability $\ge 9/10$. Hence any adaptive algorithm that has $o(\log n/\log\log n)$ rounds must use an overall $\Omega(n^2)$ linear measurements. Our techniques also readily extend to obtain lower bounds on adaptive algorithms for tensor recovery and obtain measurement-vs-rounds trade-off for many sensing problems in numerical linear algebra, such as spectral norm low rank approximation, Frobenius norm low rank approximation, singular vector approximation, and more.

Near-optimal estimation of simultaneously sparse and low-rank matrices from nested linear measurements

Robust Sensing of Low-Rank Matrices with Non-Orthogonal Sparse Decomposition

Near Optimal Compressed Sensing of a Class of Sparse Low-Rank Matrices via Sparse Power Factorization

A NONCONVEX ALGORITHM FOR SIMULTANEOUSLY SPARSE AND LOW-RANK MATRIX RECONSTRUCTION

Low-Rank Matrix Estimation from Rank-One Projections by Unlifted Convex Optimization

Estimation of high-dimensional low-rank matrices

Fundamental limits of Non-Linear Low-Rank Matrix Estimation

A Measurement-Efficient Low-Rank Matrix Recovery Approach

Guarantees of Riemannian Optimization for Low Rank Matrix Recovery

Generalized Low-rank plus Sparse Tensor Estimation by Fast Riemannian Optimization

Novel Algorithm for Sparse Solutions to Linear Inverse Problems with Multiple Measurements

Lower Bounds on Adaptive Sensing for Matrix Recovery

Low Rank Approximation and Regression in Input Sparsity Time

Two step recovery of jointly sparse and low-rank matrices: theoretical guarantees

Beyond Procrustes: Balancing-Free Gradient Descent for Asymmetric Low-Rank Matrix Sensing

Learning-Based Low-Rank Approximations

Parameter Estimation for Generalized Low-Rank Matrix Sensing by Learning on Riemannian Manifolds

Sketching low-rank matrices with a shared column space by convex programming

Smoothed Low Rank and Sparse Matrix Recovery by Iteratively Reweighted Least Squares Minimization

Optimal Estimation of Structured Covariance Operators

Efficient Compressive Phase Retrieval with Constrained Sensing Vectors