Abstract:Matrix completion is often applied to data with entries missing not at random (MNAR). For example, consider a recommendation system where users tend to only reveal ratings for items they like. In this case, a matrix completion method that relies on entries being revealed at uniformly sampled row and column indices can yield overly optimistic predictions of unseen user ratings. Recently, various papers have shown that we can reduce this bias in MNAR matrix completion if we know the probabilities of different matrix entries being missing. These probabilities are typically modeled using logistic regression or naive Bayes, which make strong assumptions and lack guarantees on the accuracy of the estimated probabilities. In this paper, we suggest a simple approach to estimating these probabilities that avoids these shortcomings. Our approach follows from the observation that missingness patterns in real data often exhibit low nuclear norm structure. We can then estimate the missingness probabilities by feeding the (always fully-observed) binary matrix specifying which entries are revealed or missing to an existing nuclear-norm-constrained matrix completion algorithm by Davenport et al. [2014]. Thus, we tackle MNAR matrix completion by solving a different matrix completion problem first that recovers missingness probabilities. We establish finite-sample error bounds for how accurate these probability estimates are and how well these estimates debias standard matrix completion losses for the original matrix to be completed. Our experiments show that the proposed debiasing strategy can improve a variety of existing matrix completion algorithms, and achieves downstream matrix completion accuracy at least as good as logistic regression and naive Bayes debiasing baselines that require additional auxiliary information.

Matrix Completion for Survey Data Prediction with Multivariate Missingness

Mixed Matrix Completion in Complex Survey Sampling under Heterogeneous Missingness

Stop or Continue Data Collection: A Nonignorable Missing Data Approach for Continuous Variables

Multiple Imputation of Missing Categorical and Continuous Values via Bayesian Mixture Models with Local Dependence

A matrix completion-based multiview learning method for imputing missing values in buoy monitoring data

Structured Matrix Completion with Applications to Genomic Data Integration

Matrix Completion under Low-Rank Missing Mechanism

Imputation and low-rank estimation with Missing Not At Random data

Matrix Completion with Covariate Information

Matrix Completion with Nonuniform Sampling: Theories and Methods.

Missing Not at Random in Matrix Completion: The Effectiveness of Estimating Missingness Probabilities Under a Low Nuclear Norm Assumption

Conformalized matrix completion

Matrix Completion with Deterministic Sampling: Theories and Methods

Method for Incomplete and Imbalanced Data Based on Multivariate Imputation by Chained Equations and Ensemble Learning

Projective Resampling Imputation Mean Estimation Method for Missing Covariates Problem

Combining Probability and Nonprobability Samples by Using Multivariate Mass Imputation Approaches with Application to Biomedical Research

A method for comparing multiple imputation techniques: A case study on the U.S. national COVID cohort collaborative

Entry-Specific Matrix Estimation under Arbitrary Sampling Patterns through the Lens of Network Flows

Handling Nonmonotone Missing Data with Available Complete-Case Missing Value Assumption

Post-surgical Complication Prediction in the Presence of Low-Rank Missing Data.

Imputations for High Missing Rate Data in Covariates Via Semi-supervised Learning Approach