Abstract:Objectives: Missing data is a recurrent issue in many fields of medical research, particularly in questionnaires. The aim of this article is to describe and compare six conceptually different multiple imputation methods, alongside the commonly used complete case analysis, and to explore whether the choice of methodology for handling missing data might impact clinical conclusions drawn from a regression model when data are categorical. Methods: In addition to the commonly used complete case analysis, we tested the following six imputation methods: multiple imputation using expectation–maximization with bootstrapping, multiple imputation using multiple correspondence analysis, multiple imputation using latent class analysis, multiple hot deck imputation and multivariate imputation by chained equations with two different model specifications: logistic regression and random forests. The methods are tested on real data from a questionnaire-based study in the Norwegian opioid maintenance treatment programme. Results: All methods performed relatively well when the sample size was large (n = 1000). For a smaller sample size (n = 200), the regression estimates depend heavily on the level of missing. When the amount of missing was ⩾20%, in particular, complete case analysis, hot deck and random forests had biased estimates with too low coverage. Multiple imputation using multiple correspondence analysis had the best performance all over. Conclusion: The choice of missing handling methodology has a significant impact on the clinical interpretation of the accompanying statistical analyses. With missing data, the choice of whether to impute or not, and choice of imputation method, can influence clinical conclusion drawn from a regression model and should therefore be given sufficient consideration.

To impute or not? Testing multivariate normality on incomplete dataset: revisiting the BHEP test

To impute or not to? Testing multivariate normality on incomplete dataset: Revisiting the BHEP test

The Bias and Efficiency of Incomplete-Data Estimators in Small Univariate Normal Samples

Missing at Random or Not: A Semiparametric Testing Approach

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Multivariate One-Sided Tests for Multivariate Normal and Nonlinear Mixed Effects Models with Complete and Incomplete Data

Multiple imputation for missing data: fully conditional specification versus multivariate normal imputation

Testing multivariate normality by testing independence

MMD Two-sample Testing in the Presence of Arbitrarily Missing Data

How handling missing data may impact conclusions: A comparison of six different imputation methods for categorical questionnaire data

On two-sample testing for data with arbitrarily missing values

The impact of imputation methods on the performance of Phase I Hotelling's T2 control chart

Handling Nonmonotone Missing Data with Available Complete-Case Missing Value Assumption

A new approach for approximating the p-value of a class of bivariate sign tests

Power analysis of several normality tests: A Monte Carlo simulation study

Tests of Missing Completely At Random based on sample covariance matrices

Estimation of Proportion of Null Hypotheses Under Dependence

Inference following multiple imputation for generalized additive models: an investigation of the median p-value rule with applications to the Pulmonary Hypertension Association Registry and Colorado COVID-19 hospitalization data

Hypothesis testing in nonparametric models of production using multiple sample splits

Towards a theory for testing statistical hypothesis: Multivariate mean with nuisance covariance matrix

Power Enhancement in High Dimensional Cross-Sectional Tests