Abstract:Practical problems with missing data are common, and statistical methods have been developed concerning the validity and/or efficiency of statistical procedures. On a central focus, there have been longstanding interests on the mechanism governing data missingness, and correctly deciding the appropriate mechanism is crucially relevant for conducting proper practical investigations. The conventional notions include the three common potential classes -- missing completely at random, missing at random, and missing not at random. In this paper, we present a new hypothesis testing approach for deciding between missing at random and missing not at random. Since the potential alternatives of missing at random are broad, we focus our investigation on a general class of models with instrumental variables for data missing not at random. Our setting is broadly applicable, thanks to that the model concerning the missing data is nonparametric, requiring no explicit model specification for the data missingness. The foundational idea is to develop appropriate discrepancy measures between estimators whose properties significantly differ only when missing at random does not hold. We show that our new hypothesis testing approach achieves an objective data oriented choice between missing at random or not. We demonstrate the feasibility, validity, and efficacy of the new test by theoretical analysis, simulation studies, and a real data analysis.

Conceptual, Computational and Inferential Benefits of the Missing Data Perspective in Applied and Theoretical Statistical Problems

Statistical Data, Missing

Statistical Analysis with Missing Data

The Analysis of Social-Science Data with Missing Values

Stop or Continue Data Collection: A Nonignorable Missing Data Approach for Continuous Variables

Missing Data Imputation: Focusing on Single Imputation.

Statistical primer: how to deal with missing data in scientific research?†

Missing Data Analysis

The broad role of multiple imputation in statistical science

A probability based approach for processing dimension missing data

19 Incomplete Data in Epidemiology and Medical Statistics

Missing at Random or Not: A Semiparametric Testing Approach

Causal Inference: A Missing Data Perspective

Toward Systematic Considerations of Missingness in Visual Analytics

On Jointly Estimating Parameters and Missing Data by Maximizing the Complete-Data Likelihood

Conditions for Ignoring the Missing-Data Mechanism in Likelihood Inferences for Parameter Subsets

Missing Data Exploration: Highlighting Graphical Presentation of Missing Pattern.

Missing Values in Big Data Research: Some Basic Skills

A Comparison of Three Popular Methods for Handling Missing Data: Complete-Case Analysis, Inverse Probability Weighting, and Multiple Imputation

Bayesian Data Analysis in Empirical Software Engineering: The Case of Missing Data

A Realistic Evaluation of Methods for Handling Missing Data When There is a Mixture of MCAR, MAR, and MNAR Mechanisms in the Same Dataset