Abstract:Objectives: Missing data is a recurrent issue in many fields of medical research, particularly in questionnaires. The aim of this article is to describe and compare six conceptually different multiple imputation methods, alongside the commonly used complete case analysis, and to explore whether the choice of methodology for handling missing data might impact clinical conclusions drawn from a regression model when data are categorical. Methods: In addition to the commonly used complete case analysis, we tested the following six imputation methods: multiple imputation using expectation–maximization with bootstrapping, multiple imputation using multiple correspondence analysis, multiple imputation using latent class analysis, multiple hot deck imputation and multivariate imputation by chained equations with two different model specifications: logistic regression and random forests. The methods are tested on real data from a questionnaire-based study in the Norwegian opioid maintenance treatment programme. Results: All methods performed relatively well when the sample size was large (n = 1000). For a smaller sample size (n = 200), the regression estimates depend heavily on the level of missing. When the amount of missing was ⩾20%, in particular, complete case analysis, hot deck and random forests had biased estimates with too low coverage. Multiple imputation using multiple correspondence analysis had the best performance all over. Conclusion: The choice of missing handling methodology has a significant impact on the clinical interpretation of the accompanying statistical analyses. With missing data, the choice of whether to impute or not, and choice of imputation method, can influence clinical conclusion drawn from a regression model and should therefore be given sufficient consideration.

Missing Data Analysis

Meta‐Analysis of Studies with Missing Data

The Analysis of Social-Science Data with Missing Values

Statistical Analysis with Missing Data

Statistical Data, Missing

Best practices for missing data management in counseling psychology.

A Comparison of Three Popular Methods for Handling Missing Data: Complete-Case Analysis, Inverse Probability Weighting, and Multiple Imputation

Missing data: issues, concepts, methods

Missing Data Imputation: Focusing on Single Imputation.

19 Incomplete Data in Epidemiology and Medical Statistics

Missing Values in Big Data Research: Some Basic Skills

Analysis of Missingness Scenarios for Observational Health Data

A Description of Missing Data in Single-Case Experimental Designs Studies and an Evaluation of Single Imputation Methods

Imputation methods for mixed datasets in bioarchaeology

Statistical primer: how to deal with missing data in scientific research?†

Missing data approaches for longitudinal neuroimaging research: Examples from the Adolescent Brain and Cognitive Development (ABCD) Study

How handling missing data may impact conclusions: A comparison of six different imputation methods for categorical questionnaire data

Missing Data Exploration: Highlighting Graphical Presentation of Missing Pattern.

Dealing with missing data in multi-informant studies: A comparison of approaches

The Effect of Missing Item Data on the Relative Predictive Accuracy of Correctional Risk Assessment Tools

A survey of methodologies for the treatment of missing values within datasets: limitations and benefits