Abstract:Matrix completion tackles the task of predicting missing values in a low-rank matrix based on a sparse set of observed entries. It is often assumed that the observation pattern is generated uniformly at random or has a very specific structure tuned to a given algorithm. There is still a gap in our understanding when it comes to arbitrary sampling patterns. Given an arbitrary sampling pattern, we introduce a matrix completion algorithm based on network flows in the bipartite graph induced by the observation pattern. For additive matrices, the particular flow we used is the electrical flow and we establish error upper bounds customized to each entry as a function of the observation set, along with matching minimax lower bounds. Our results show that the minimax squared error for recovery of a particular entry in the matrix is proportional to the effective resistance of the corresponding edge in the graph. Furthermore, we show that our estimator is equivalent to the least squares estimator. We apply our estimator to the two-way fixed effects model and show that it enables us to accurately infer individual causal effects and the unit-specific and time-specific confounders. For rank-$1$ matrices, we use edge-disjoint paths to form an estimator that achieves minimax optimal estimation when the sampling is sufficiently dense. Our discovery introduces a new family of estimators parametrized by network flows, which provide a fine-grained and intuitive understanding of the impact of the given sampling pattern on the relative difficulty of estimation at an entry-specific level. This graph-based approach allows us to quantify the inherent complexity of matrix completion for individual entries, rather than relying solely on global measures of performance.

Entry-Specific Bounds for Low-Rank Matrix Completion under Highly Non-Uniform Sampling

Matrix Completion from Non-Uniformly Sampled Entries.

Entry-Specific Matrix Estimation under Arbitrary Sampling Patterns through the Lens of Network Flows

Information-Guided Sampling for Low-Rank Matrix Completion

Rank Determination for Low-Rank Data Completion

Matrix Completion with Nonuniform Sampling: Theories and Methods.

Estimation of high-dimensional low-rank matrices

Outlier-robust sparse/low-rank least-squares regression and robust matrix completion

Symmetric Matrix Completion with ReLU Sampling

Low-rank matrix completion and denoising under Poisson noise

Robust Matrix Completion with Deterministic Sampling via Convex Optimization

Matrix Completion Via Minimizing an Approximate Rank

Matrix Completion under Low-Rank Missing Mechanism

Leveraged Matrix Completion with Noise

Lower Bounds on the Mean-Squared Error of Low-Rank Matrix Reconstruction

A Nearly Unbiased Matrix Completion Approach.

Near-Optimal Entrywise Sampling for Data Matrices

Max-norm optimization for robust matrix recovery

One-sided Matrix Completion from Two Observations Per Row

Low-Rank Matrix Completion Based on Maximum Likelihood Estimation.

A robust low-rank matrix completion based on truncated nuclear norm and Lp-norm