Abstract:Dealing with missing data is an important problem in statistical analysis that is often addressed with imputation procedures. The performance and validity of such methods are of great importance for their application in empirical studies. While the prevailing method of Multiple Imputation by Chained Equations (MICE) with Predictive Mean Matching (PMM) is considered standard in the social science literature, the increase in complex datasets may require more advanced approaches based on machine learning. In particular, tree-based imputation methods have emerged as very competitive approaches. However, the performance and validity are not completely understood, particularly compared to the standard MICE PMM. This is especially true for inference in linear models. In this study, we investigate the impact of various imputation methods on coefficient estimation, Type I error, and power, to gain insights that can help empirical researchers deal with missingness more effectively. We explore MICE PMM alongside different tree-based methods, such as MICE with Random Forest (RF), Chained Random Forests with and without PMM (missRanger), and Extreme Gradient Boosting (MIXGBoost), conducting a realistic simulation study using the German National Educational Panel Study (NEPS) as the original data source. Our results reveal that Random Forest-based imputations, especially MICE RF and missRanger with PMM, consistently perform better in most scenarios. Standard MICE PMM shows partially increased bias and overly conservative test decisions, particularly with non-true zero coefficients. Our results thus underscore the potential advantages of tree-based imputation methods, albeit with a caveat that all methods perform worse with an increased missingness, particularly missRanger.

Multiple imputation of multilevel missing data: An introduction to the R package pan

Multiple Imputation with Multivariate Imputation by Chained Equation (mice) Package

Multiple Imputation of Missing Categorical and Continuous Values via Bayesian Mixture Models with Local Dependence

Multiple imputation for longitudinal data: A tutorial

Missing Data Imputation: Focusing on Single Imputation.

Multiple Imputation for Multilevel Data with Continuous and Binary Variables

Implementing multiple imputations for addressing missing data in multireader multicase design studies

Missing Data Exploration: Highlighting Graphical Presentation of Missing Pattern.

Multiple Imputation with Factor Scores: A Practical Approach for Handling Simultaneous Missingness Across Items in Longitudinal Designs

Adapting tree-based multiple imputation methods for multi-level data? A simulation study

Dealing with missing data in multi-informant studies: A comparison of approaches

Solving the "many variables" problem in MICE with principal component regression

Imputing Missing Data by Fully Conditional Models : Some Cautionary Examples and Guidelines

Imputation methods for mixed datasets in bioarchaeology

Multiple Imputation for General Missing Data Patterns in the Presence of High-dimensional Data

Evaluating tree-based imputation methods as an alternative to MICE PMM for drawing inference in empirical studies

Multiple Imputation with Diagnostics ( Mi ) in R : Opening Windows into the Black Box

Multiple imputation of missing data in multilevel ecological momentary assessments: an example using smoking cessation study data

Multiple Imputation When Variables Exceed Observations: An Overview of Challenges and Solutions

Imputation of Mixed Data With Multilevel Singular Value Decomposition

AN OVERVIEW OF MULTIPLE IMPUTATION