Abstract:We give a new framework for solving the fundamental problem of low-rank matrix completion, i.e., approximating a rank-$r$ matrix $\mathbf{M} \in \mathbb{R}^{m \times n}$ (where $m \ge n$) from random observations. First, we provide an algorithm which completes $\mathbf{M}$ on $99\%$ of rows and columns under no further assumptions on $\mathbf{M}$ from $\approx mr$ samples and using $\approx mr^2$ time. Then, assuming the row and column spans of $\mathbf{M}$ satisfy additional regularity properties, we show how to boost this partial completion guarantee to a full matrix completion algorithm by aggregating solutions to regression problems involving the observations. In the well-studied setting where $\mathbf{M}$ has incoherent row and column spans, our algorithms complete $\mathbf{M}$ to high precision from $mr^{2+o(1)}$ observations in $mr^{3 + o(1)}$ time (omitting logarithmic factors in problem parameters), improving upon the prior state-of-the-art [JN15] which used $\approx mr^5$ samples and $\approx mr^7$ time. Under an assumption on the row and column spans of $\mathbf{M}$ we introduce (which is satisfied by random subspaces with high probability), our sample complexity improves to an almost information-theoretically optimal $mr^{1 + o(1)}$, and our runtime improves to $mr^{2 + o(1)}$. Our runtimes have the appealing property of matching the best known runtime to verify that a rank-$r$ decomposition $\mathbf{U}\mathbf{V}^\top$ agrees with the sampled observations. We also provide robust variants of our algorithms that, given random observations from $\mathbf{M} + \mathbf{N}$ with $\|\mathbf{N}\|_{F} \le \Delta$, complete $\mathbf{M}$ to Frobenius norm distance $\approx r^{1.5}\Delta$ in the same runtimes as the noiseless setting. Prior noisy matrix completion algorithms [CP10] only guaranteed a distance of $\approx \sqrt{n}\Delta$.

Information Theoretic Bounds for Low-Rank Matrix Completion

Uniqueness of Low-Rank Matrix Completion by Rigidity Theory

The Bounds of Restricted Isometry Constants for Low Rank Matrices Recovery

Matrix Completion in Almost-Verification Time

Completion of Matrices with Low Description Complexity

Exact Error in Matrix Completion: Approximately Low-Rank Structures and Missing Blocks

Matrix Completion under Low-Rank Missing Mechanism

Optimal Low-Rank Matrix Completion: Semidefinite Relaxations and Eigenvector Disjunctions

A Nonconvex Method to Low-Rank Matrix Completion

A Nearly Unbiased Matrix Completion Approach.

Matrix Completion with Sparse Noisy Rows

On the equivalence between low rank matrix completion and tensor rank

Decentralized Low-Rank Matrix Completion

Leveraged Matrix Completion with Noise

Lower Bounds on the Mean-Squared Error of Low-Rank Matrix Reconstruction

Information-Guided Sampling for Low-Rank Matrix Completion

Subspace-Informed Matrix Completion

Entry-Specific Bounds for Low-Rank Matrix Completion under Highly Non-Uniform Sampling

Optimal spectral norm rates for noisy low-rank matrix completion

One-sided Matrix Completion from Two Observations Per Row

A Note on the Rank of the Optimal Matrix in Symmetric Toeplitz Matrix Completion Problem