Abstract:We give a new framework for solving the fundamental problem of low-rank matrix completion, i.e., approximating a rank-$r$ matrix $\mathbf{M} \in \mathbb{R}^{m \times n}$ (where $m \ge n$) from random observations. First, we provide an algorithm which completes $\mathbf{M}$ on $99\%$ of rows and columns under no further assumptions on $\mathbf{M}$ from $\approx mr$ samples and using $\approx mr^2$ time. Then, assuming the row and column spans of $\mathbf{M}$ satisfy additional regularity properties, we show how to boost this partial completion guarantee to a full matrix completion algorithm by aggregating solutions to regression problems involving the observations. In the well-studied setting where $\mathbf{M}$ has incoherent row and column spans, our algorithms complete $\mathbf{M}$ to high precision from $mr^{2+o(1)}$ observations in $mr^{3 + o(1)}$ time (omitting logarithmic factors in problem parameters), improving upon the prior state-of-the-art [JN15] which used $\approx mr^5$ samples and $\approx mr^7$ time. Under an assumption on the row and column spans of $\mathbf{M}$ we introduce (which is satisfied by random subspaces with high probability), our sample complexity improves to an almost information-theoretically optimal $mr^{1 + o(1)}$, and our runtime improves to $mr^{2 + o(1)}$. Our runtimes have the appealing property of matching the best known runtime to verify that a rank-$r$ decomposition $\mathbf{U}\mathbf{V}^\top$ agrees with the sampled observations. We also provide robust variants of our algorithms that, given random observations from $\mathbf{M} + \mathbf{N}$ with $\|\mathbf{N}\|_{F} \le \Delta$, complete $\mathbf{M}$ to Frobenius norm distance $\approx r^{1.5}\Delta$ in the same runtimes as the noiseless setting. Prior noisy matrix completion algorithms [CP10] only guaranteed a distance of $\approx \sqrt{n}\Delta$.

Row or column completion of polynomial matrices of given degree II

Row or Column Completion of Polynomial Matrices of Given Degree

A-infinity Structures Related to Bi-Koszul Algebras

Multiple typical ranks in matrix completion

Completion of Matrices with Low Description Complexity

Matrix Completion in Almost-Verification Time

Uniqueness of Low-Rank Matrix Completion by Rigidity Theory

Matrix Completion for the Independence Model

Quasi-Hankel low-rank matrix completion: a convex relaxation

Even grade generic skew-symmetric matrix polynomials with bounded rank

On Column Competent Matrices and Linear Complementarity Problem

Matrices over polynomial rings approached by commutative algebra

Missing Entries Matrix Approximation and Completion

On prescribed characteristic polynomials

Matrix completion algorithms with optimal phase transition

One-sided Matrix Completion from Two Observations Per Row

Matrix Completion over Finite Fields: Bounds and Belief Propagation Algorithms

Constructive Non-Commutative Rank Computation is in Deterministic Polynomial Time.

On m-tuples of nilpotent 2x2 matrices over an arbitrary field

Exact Error in Matrix Completion: Approximately Low-Rank Structures and Missing Blocks

On bundle closures of matrix pencils and matrix polynomials