Abstract:Background: The COVID-19 pandemic has revealed significant challenges in disease forecasting and in developing a public health response, emphasizing the need to manage missing data from various sources in making accurate forecasts. Objective: We aimed to show how handling missing data can affect estimates of the COVID-19 incidence rate (CIR) in different pandemic situations. Methods: This study used data from the COVID-19/SARS-CoV-2 surveillance system at the National Institute of Hygiene and Epidemiology, Vietnam. We separated the available data set into 3 distinct periods: zero COVID-19, transition, and new normal. We randomly removed 5% to 30% of data that were missing completely at random, with a break of 5% at each time point in the variable daily caseload of COVID-19. We selected 7 analytical methods to assess the effects of handling missing data and calculated statistical and epidemiological indices to measure the effectiveness of each method. Results: Our study examined missing data imputation performance across 3 study time periods: zero COVID-19 (n=3149), transition (n=1290), and new normal (n=9288). Imputation analyses showed that K-nearest neighbor (KNN) had the lowest mean absolute percentage change (APC) in CIR across the range (5% to 30%) of missing data. For instance, with 15% missing data, KNN resulted in 10.6%, 10.6%, and 9.7% average bias across the zero COVID-19, transition, and new normal periods, compared to 39.9%, 51.9%, and 289.7% with the maximum likelihood method. The autoregressive integrated moving average model showed the greatest mean APC in the mean number of confirmed cases of COVID-19 during each COVID-19 containment cycle (CCC) when we imputed the missing data in the zero COVID-19 period, rising from 226.3% at the 5% missing level to 6955.7% at the 30% missing level. Imputing missing data with median imputation methods had the lowest bias in the average number of confirmed cases in each CCC at all levels of missing data. In detail, in the 20% missing scenario, while median imputation had an average bias of 16.3% for confirmed cases in each CCC, which was lower than the KNN figure, maximum likelihood imputation showed a bias on average of 92.4% for confirmed cases in each CCC, which was the highest figure. During the new normal period in the 25% and 30% missing data scenarios, KNN imputation had average biases for CIR and confirmed cases in each CCC ranging from 21% to 32% for both, while maximum likelihood and moving average imputation showed biases on average above 250% for both CIR and confirmed cases in each CCC. Conclusions: Our study emphasizes the importance of understanding that the specific imputation method used by investigators should be tailored to the specific epidemiological context and data collection environment to ensure reliable estimates of the CIR.

Truncation Data Analysis for the Under-Reporting Probability in COVID-19 Pandemic

Exploring the impact of under-reported cases on the COVID-19 spatiotemporal distribution using healthcare worker infection data

Estimating the Number of Infected Cases in COVID-19 Pandemic

A Quantitative Method to Project the Probability of the End of an Epidemic: Application to the COVID-19 Outbreak in Wuhan, 2020.

Inferencing superspreading potential using zero-truncated negative binomial model: exemplification with COVID-19

Spatiotemporal Estimation of COVID-19 Outbreak Using Infection Data of Healthcare Workers

Bayesian hierarchical spatiotemporal models for prediction of (under)reporting rates and cases: COVID-19 infection among the older people in the United States during the 2020-2022 pandemic

Toward a Country-Based Prediction Model of COVID-19 Infections and Deaths Between Disease Apex and End: Evidence from Countries with Contained Numbers of COVID-19.

Data-driven Identification of Number of Unreported Cases for COVID-19: Bounds and Limitations

Adaptive Multi-Factor Quantitative Analysis and Prediction Models: Vaccination, Virus Mutation and Social Isolation on COVID-19

Maximum Full Likelihood Approach to Randomly Truncated Data

Determining the Covertness of COVID-19 - Wuhan, China, 2020.

Quantitative assessment of the role of undocumented infection in the 2019 novel coronavirus (COVID-19) pandemic

A method for estimating the case fatality rate during the onging epidemic A Case Study of COVID 19

A new method for accurate calculation of case fatality rate during a pandemic (Preprint)

A New Method for Accurate Calculation of Case Fatality Rates During a Pandemic: Mathematical Deduction Based on Population-Level Big Data

A Sampling Scheme for Estimating the Prevalence of a Pandemic

Handling Missing Data in COVID-19 Incidence Estimation: Secondary Data Analysis

Quantitative Analysis and Mathematic Modeling of the Global Outbreak of COVID-19.

Discrete Epidemic Modelling of COVID-19 Transmission in Shaanxi Province with Media Reporting and Imported Cases

Quantitative Study on American COVID-19 Epidemic Predictions and Scenario Simulations