Predicting blood pressure under circumstances of missing data: An analysis of missing data patterns and imputation methods using NHANES

Harish Chauhan,Nikunj Gupta,Zoe Haskell-Craig
2023-05-02
Abstract:The World Health Organization defines cardio-vascular disease (CVD) as "a group of disorders of the heart and blood vessels," including coronary heart disease and stroke (WHO 21). CVD is affected by "intermediate risk factors" such as raised blood pressure, raised blood glucose, raised blood lipids, and obesity. These are predominantly influenced by lifestyle and behaviour, including physical inactivity, unhealthy diets, high intake of salt, and tobacco and alcohol use. However, genetics and social/environmental factors such as poverty, stress, and racism also play an important role. Researchers studying the behavioural and environmental factors associated with these "intermediate risk factors" need access to high quality and detailed information on diet and physical activity. However, missing data are a pervasive problem in clinical and public health research, affecting both randomized trials and observational studies. Reasons for missing data can vary substantially across studies because of loss to follow-up, missed study visits, refusal to answer survey questions, or an unrecorded measurement during an office visit. One method of handling missing values is to simply delete observations for which there is missingness (called Complete Case Analysis). This is rarely used as deleting the data point containing missing data (List wise deletion) results in a smaller number of samples and thus affects accuracy. Additional methods of handling missing data exists, such as summarizing the variables with its observed values (Available Case Analysis). Motivated by the pervasiveness of missing data in the NHANES dataset, we will conduct an analysis of imputation methods under different simulated patterns of missing data. We will then apply these imputation methods to create a complete dataset upon which we can use ordinary least squares to predict blood pressure from diet and physical activity.
Machine Learning,Methodology
What problem does this paper attempt to address?
This paper aims to address the prevalent issue of missing data in clinical and public health research, particularly in the prediction of blood pressure related to cardiovascular disease (CVD). Specifically, the authors utilize the National Health and Nutrition Examination Survey (NHANES) dataset to analyze the performance of various imputation methods under different missing data patterns (Missing Completely at Random MCAR, Missing at Random MAR, Missing Not at Random MNAR) and predict the impact of diet and physical activity on blood pressure through Ordinary Least Squares (OLS) regression. ### Main Objectives: 1. **Analyze Different Imputation Methods**: Evaluate the effectiveness of mean imputation, median imputation, mode imputation, K-nearest neighbors imputation, low-rank approximation imputation, and multiple regression imputation in handling different types of missing data in the NHANES dataset. 2. **Predict Blood Pressure**: After addressing the missing data issue, use the complete dataset to perform OLS regression analysis to explore the relationship between lifestyle factors (such as diet and exercise) and blood pressure. ### Research Findings: - **Multiple Regression Imputation Performed Best**: Regardless of the MCAR, MAR, or MNAR patterns, the multiple regression imputation method outperformed other imputation methods. - **Actual Prediction Results**: Although theoretical analysis showed that multiple regression imputation was the best, the model using median imputation performed best when predicting blood pressure on the complete dataset. ### Conclusion: This paper systematically compares the performance of various imputation methods under different missing data patterns, demonstrating the superiority of multiple regression imputation in simulated data. However, in practical application, simple median imputation achieved the best predictive performance. This finding suggests that researchers should consider the specific characteristics of the dataset and the degree of association between its variables when choosing an imputation strategy.