Abstract:The ubiquity of missing values in real-world datasets poses a challenge for statistical inference and can prevent similar datasets from being analyzed in the same study, precluding many existing datasets from being used for new analyses. While an extensive collection of packages and algorithms have been developed for data imputation, the overwhelming majority perform poorly if there are many missing values and low sample sizes, which are unfortunately common characteristics in empirical data. Such low-accuracy estimations adversely affect the performance of downstream statistical models. We develop a statistical inference framework for regression and classification in the presence of missing data without imputation. Our framework, RIFLE (Robust InFerence via Low-order moment Estimations), estimates low-order moments of the underlying data distribution with corresponding confidence intervals to learn a distributionally robust model. We specialize our framework to linear regression and normal discriminant analysis, and we provide convergence and performance guarantees. This framework can also be adapted to impute missing data. In numerical experiments, we compare RIFLE to several state-of-the-art approaches (including MICE, Amelia, MissForest, KNN-imputer, MIDA, and Mean Imputer) for imputation and inference in the presence of missing values. Our experiments demonstrate that RIFLE outperforms other benchmark algorithms when the percentage of missing values is high and/or when the number of data points is relatively small. RIFLE is publicly available at <a class="link-external link-https" href="https://github.com/optimization-for-data-driven-science/RIFLE" rel="external noopener nofollow">this https URL</a>.

SIHR: An R Package for Statistical Inference in High-dimensional Linear and Logistic Regression Models

SIHR: Statistical Inference in High-Dimensional Linear and Logistic Regression Models

Statistical Inference and Large-scale Multiple Testing for High-dimensional Regression Models

itdr: An R package of Integral Transformation Methods to Estimate the SDR Subspaces in Regression

Sparsified simultaneous confidence intervals for high-dimensional linear models

Statistical Inference in High-dimensional Poisson Regression with Applications to Mediation Analysis

Inference for High-Dimensional Linear Mixed-Effects Models: A Quasi-Likelihood Approach

intRinsic: an R Package for Model-Based Estimation of the Intrinsic Dimension of a Dataset

Statistical Inference for High-Dimensional Generalized Linear Models With Binary Outcomes

Robust Inference for High-dimensional Linear Models with Heavy-tailed Errors via Partial Gini Covariance

High-dimensional robust inference for censored linear models

A Tutorial on Libra: R package for the Linearized Bregman Algorithm in High Dimensional Statistics

Confidence Intervals for Low-Dimensional Parameters in High-Dimensional Linear Models

Confidence Intervals and Hypothesis Testing for High-Dimensional Regression

AdaptiveConformal: An R Package for Adaptive Conformal Inference

RIFLE: Imputation and Robust Inference from Low Order Marginals

Statistical Inference for High-Dimensional Models via Recursive Online-Score Estimation

g.ridge: An R Package for Generalized Ridge Regression for Sparse and High-Dimensional Linear Models

High-dimensional model-assisted inference for treatment effects with multi-valued treatments

Doubly Robust Semiparametric Inference Using Regularized Calibrated Estimation with High-dimensional Data

BayesVarSel: Bayesian Testing, Variable Selection and model averaging in Linear Models using R