Abstract:Matrix completion is often applied to data with entries missing not at random (MNAR). For example, consider a recommendation system where users tend to only reveal ratings for items they like. In this case, a matrix completion method that relies on entries being revealed at uniformly sampled row and column indices can yield overly optimistic predictions of unseen user ratings. Recently, various papers have shown that we can reduce this bias in MNAR matrix completion if we know the probabilities of different matrix entries being missing. These probabilities are typically modeled using logistic regression or naive Bayes, which make strong assumptions and lack guarantees on the accuracy of the estimated probabilities. In this paper, we suggest a simple approach to estimating these probabilities that avoids these shortcomings. Our approach follows from the observation that missingness patterns in real data often exhibit low nuclear norm structure. We can then estimate the missingness probabilities by feeding the (always fully-observed) binary matrix specifying which entries are revealed or missing to an existing nuclear-norm-constrained matrix completion algorithm by Davenport et al. [2014]. Thus, we tackle MNAR matrix completion by solving a different matrix completion problem first that recovers missingness probabilities. We establish finite-sample error bounds for how accurate these probability estimates are and how well these estimates debias standard matrix completion losses for the original matrix to be completed. Our experiments show that the proposed debiasing strategy can improve a variety of existing matrix completion algorithms, and achieves downstream matrix completion accuracy at least as good as logistic regression and naive Bayes debiasing baselines that require additional auxiliary information.

Enhancing Prony’s method by nuclear norm penalization and extension to missing data

Matrix completion by Truncated Nuclear Norm Regularization

Fast and Accurate Matrix Completion Via Truncated Nuclear Norm Regularization

Low-rank matrix completion and denoising under Poisson noise

On the accuracy of Prony's method for recovery of exponential sums with closely spaced exponents

Missing Not at Random in Matrix Completion: The Effectiveness of Estimating Missingness Probabilities Under a Low Nuclear Norm Assumption

Semi-Proximal ADMM for Primal and Dual Robust Low-Rank Matrix Restoration from Corrupted Observations

Reweighted nuclear norm regularization: A SPARSEVA approach

Max-norm optimization for robust matrix recovery

Low-Rank Approximation via Generalized Reweighted Iterative Nuclear and Frobenius Norms

A Bregman Proximal ADMM for NMF with Outliers: Estimating features with missing values and outliers: a Bregman-proximal point algorithm for robust Non-negative Matrix Factorization with application to gene expression analysis

An Improved Dual Asymmetric Penalized Least Squares Baseline Correction Method for High-Noise Spectral Data Analysis

Sparse inference in Poisson Log-Normal model by approximating the L0-norm

A robust low-rank matrix completion based on truncated nuclear norm and Lp-norm

A Scalable, Adaptive and Sound Nonconvex Regularizer for Low-rank Matrix Learning

A truncated nuclear norm regularization model for signal extraction from GNSS coordinate time series

Pattern Alternating Maximization Algorithm for Missing Data in Large P, Small N Problems

Principal Component Pursuit with Weighted Nuclear Norm

Basis Pursuit Denoise with Nonsmooth Constraints

An Investigation of Methods for Handling Missing Data with Penalized Regression

Optimal spectral norm rates for noisy low-rank matrix completion