Abstract:Recently, Musco and Woodruff (FOCS, 2017) showed that given an $n \times n$ positive semidefinite (PSD) matrix $A$, it is possible to compute a $(1+\epsilon)$-approximate relative-error low-rank approximation to $A$ by querying $O(nk/\epsilon^{2.5})$ entries of $A$ in time $O(nk/\epsilon^{2.5} +n k^{\omega-1}/\epsilon^{2(\omega-1)})$. They also showed that any relative-error low-rank approximation algorithm must query $\Omega(nk/\epsilon)$ entries of $A$, this gap has since remained open. Our main result is to resolve this question by obtaining an optimal algorithm that queries $O(nk/\epsilon)$ entries of $A$ and outputs a relative-error low-rank approximation in $O(n(k/\epsilon)^{\omega-1})$ time. Note, our running time improves that of Musco and Woodruff, and matches the information-theoretic lower bound if the matrix-multiplication exponent $\omega$ is $2$. We then extend our techniques to negative-type distance matrices. Bakshi and Woodruff (NeurIPS, 2018) showed a bi-criteria, relative-error low-rank approximation which queries $O(nk/\epsilon^{2.5})$ entries and outputs a rank-$(k+4)$ matrix. We show that the bi-criteria guarantee is not necessary and obtain an $O(nk/\epsilon)$ query algorithm, which is optimal. Our algorithm applies to all distance matrices that arise from metrics satisfying negative-type inequalities, including $\ell_1, \ell_2,$ spherical metrics and hypermetrics. Next, we introduce a new robust low-rank approximation model which captures PSD matrices that have been corrupted with noise. While a sample complexity lower bound precludes sublinear algorithms for arbitrary PSD matrices, we provide the first sublinear time and query algorithms when the corruption on the diagonal entries is bounded. As a special case, we show sample-optimal sublinear time algorithms for low-rank approximation of correlation matrices corrupted by noise.

Minimax optimal seriation in polynomial time

Seriation of Tœplitz and latent position matrices: optimal rates and computational trade-offs

Optimal rates for ranking a permuted isotonic matrix in polynomial time

Matrix Reordering for Noisy Disordered Matrices: Optimality and Computationally Efficient Algorithms

Extending Robinson Spaces: Complexity and Algorithmic Solutions for Non-Symmetric Dissimilarity Spaces

Hitting the High Notes: Subset Selection for Maximizing Expected Order Statistics

Multiple sequences Prophet Inequality Under Observation Constraints

The Rank-Ramsey Problem and the Log-Rank Conjecture

Minimizing the Minimizers via Alphabet Reordering

Optimal Online Discrepancy Minimization

Exploring Algorithmic Limits of Matrix Rank Minimization under Affine Constraints

Irreducibility over the Max-Min Semiring

An Algorithm to Recover Shredded Random Matrices

Robust and Sample Optimal Algorithms for PSD Low-Rank Approximation

Statistical limits of dictionary learning: random matrix theory and the spectral replica method

Sorting and Selection in Posets

Optimal $(0,1)$-Matrix Completion with Majorization Ordered Objectives (To the memory of Pravin Varaiya)

Matrix denoising: Bayes-optimal estimators via low-degree polynomials

Recovering a Magnitude-Symmetric Matrix from its Principal Minors

Fast Deterministic Chromatic Number under the Asymptotic Rank Conjecture

Constructive Non-Commutative Rank Computation is in Deterministic Polynomial Time.