Using Electronic Medical Records to Predict Mortality in Primary Care Patients with Heart Disease

William M. Tierney,Blaine Y. Takesue,Dennis L. Vargo,Xiao-Hua Zhou

DOI: https://doi.org/10.1007/bf02599583

IF: 5.7

1996-01-01

Journal of General Internal Medicine

Abstract:OBJECTIVE: To identify high-risk patients with heart disease by using data stored in an electronic medical record system to predict six-year mortality.

What problem does this paper attempt to address?

Assessing Statewide All-Cause Future One-Year Mortality: Prospective Study With Implications for Quality of Life, Resource Utilization, and Medical Futility.

Yanting Guo,Gang Zheng,Tianyun Fu,Shiying Hao,Chengyin Ye,Le Zheng,Modi Liu,Minjie Xia,Bo Jin,Chunqing Zhu,Oliver Wang,Qian Wu,Devore S Culver,Shaun T Alfreds,Frank Stearns,Laura Kanov,Ajay Bhatia,Karl G Sylvester,Eric Widen,Doff B McElhinney,Xuefeng Bruce Ling

DOI: https://doi.org/10.2196/10311

IF: 7.076

2018-01-01

Journal of Medical Internet Research

Abstract:Background: For many elderly patients, a disproportionate amount of health care resources and expenditures is spent during the last year of life, despite the discomfort and reduced quality of life associated with many aggressive medical approaches. However, few prognostic tools have focused on predicting all-cause 1-year mortality among elderly patients at a statewide level, an issue that has implications for improving quality of life while distributing scarce resources fairly. Objective: Using data from a statewide elderly population (aged >= 65 years), we sought to prospectively validate an algorithm to identify patients at risk for dying in the next year for the purpose of minimizing decision uncertainty, improving quality of life, and reducing futile treatment. Methods: Analysis was performed using electronic medical records from the Health Information Exchange in the state of Maine, which covered records of nearly 95% of the statewide population. The model was developed from 125,896 patients aged at least 65 years who were discharged from any care facility in the Health Information Exchange network from September 5, 2013, to September 4, 2015. Validation was conducted using 153,199 patients with same inclusion and exclusion criteria from September 5, 2014, to September 4, 2016. Patients were stratified into risk groups. The association between all-cause 1-year mortality and risk factors was screened by chi-squared test and manually reviewed by 2 clinicians. We calculated risk scores for individual patients using a gradient tree-based boost algorithm, which measured the probability of mortality within the next year based on the preceding 1-year clinical profile. Results: The development sample included 125,896 patients (72,572 women, 57.64%; mean 74.2 [SD 7.7] years). The final validation cohort included 153,199 patients (88,177 women, 57.56%; mean 74.3 [SD 7.8] years). The c-statistic for discrimination was 0.96 (95% CI 0.93-0.98) in the development group and 0.91 (95% CI 0.90-0.94) in the validation cohort. The mortality was 0.99% in the low-risk group, 16.75% in the intermediate-risk group, and 72.12% in the high-risk group. A total of 99 independent risk factors (n= 99) for mortality were identified (reported as odds ratios; 95% CI). Age was on the top of list (1.41; 1.06-1.48); congestive heart failure (20.90; 15.41-28.08) and different tumor sites were also recognized as driving risk factors, such as cancer of the ovaries (14.42; 2.24-53.04), colon (14.07; 10.08-19.08), and stomach (13.64; 3.26-86.57). Disparities were also found in patients' social determinants like respiratory hazard index (1.24; 0.92-1.40) and unemployment rate (1.18; 0.98-1.24). Among high-risk patients who expired in our dataset, cerebrovascular accident, amputation, and type 1 diabetes were the top 3 diseases in terms of average cost in the last year of life. Conclusions: Our study prospectively validated an accurate 1-year risk prediction model and stratification for the elderly population (>= 65 years) at risk of mortality with statewide electronic medical record datasets. It should be a valuable adjunct for helping patients to make better quality-of-life choices and alerting care givers to target high-risk elderly for appropriate care and discussions, thus cutting back on futile treatment.
A Method for the Early Prediction of Chronic Diseases Based on Short Sequential Medical Data.

Chengkai Wu,Tianshu Zhou,Yu Tian,Junya Wu,Jingsong Li,Zhong Liu

DOI: https://doi.org/10.1016/j.artmed.2022.102262

IF: 7.011

2022-01-01

Artificial Intelligence in Medicine

Abstract:Noncommunicable diseases (NCDs) have become the leading cause of death worldwide. NCDs' chronicity, hiddenness, and irreversibility make patients' disease self-awareness extremely important in disease control but hard to achieve. With an accumulation of electronic health record (EHR) data, it has become possible to predict NCDs early through machine learning approaches. However, EHR data from latent NCD patients are often irregularly sampled temporally, and the data sequences are short and imbalanced, which prevents researchers from fully and effectively using such data. Here, we outline the characteristics of typical short sequential data for NCD early prediction and emphasize the importance of using such data in machine learning schemes. We then propose a novel NCD early prediction method: the short sequential medical data-based early prediction method (SSEPM). The SSEPM network contains two stacked subnetworks for multilabel enhancement. In each subnetwork, long short-term memory (LSTM) and attention layers are implemented to extract both temporal and nontemporal embedded features. During training, with prior clinical knowledge of the NCD characteristics, a random connection (RC) process is proposed for data augmentation. Comparative experiments involving ten-fold cross-validation are performed with real-world medical data to predict 5 NCDs. The result shows that the SSEPM outperforms the state-of-the-art NCD early prediction algorithms and works well in dealing with short sequential data. The results also suggest that the direct use of short sequential data could be more effective than formatting datasets with temporal exclusion limitations.
Using Primary Health Care Electronic Medical Records to Predict Hospitalizations, Emergency Department Visits, and Mortality: A Systematic Review

Rebecca Johnson,Thomas Chang,Rahim Moineddin,Tara Upshaw,Noah Crampton,Emma Wallace,Andrew D Pinto

DOI: https://doi.org/10.3122/jabfm.2023.230381R1

Abstract:Introduction: High-quality primary care can reduce avoidable emergency department visits and emergency hospitalizations. The availability of electronic medical record (EMR) data and capacities for data storage and processing have created opportunities for predictive analytics. This systematic review examines studies which predict emergency department visits, hospitalizations, and mortality using EMR data from primary care. Methods: Six databases (Ovid MEDLINE, PubMed, Embase, EBM Reviews (Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects, Cochrane Central Register of Controlled Trials, Cochrane Methodology Register, Health Technology Assessment, NHS Economic Evaluation Database), Scopus, CINAHL) were searched to identify primary peer-reviewed studies in English from inception to February 5, 2020. The search was initially conducted on January 18, 2019, and updated on February 5, 2020. Results: A total of 9456 citations were double-reviewed, and 31 studies met the inclusion criteria. The predictive ability measured by C-statistics (ROC) of the best performing models from each study ranged from 0.57 to 0.95. Less than half of the included studies used artificial intelligence methods and only 7 (23%) were externally validated. Age, medical diagnoses, sex, medication use, and prior health service use were the most common predictor variables. Few studies discussed or examined the clinical utility of models. Conclusions: This review helps address critical gaps in the literature regarding the potential of primary care EMR data. Despite further work required to address bias and improve the quality and reporting of prediction models, the use of primary care EMR data for predictive analytics holds promise.
Prediction of Short-Term Mortality in Acute Heart Failure Patients Using Minimal Electronic Health Record Data

Radhachandran Ashwath,Garikipati Anurag,Zelin Nicole S.,Pellegrini Emily,Ghandian Sina,Calvert Jacob,Hoffman Jana,Mao Qingqing,Das Ritankar

DOI: https://doi.org/10.1186/s13040-021-00255-w

2021-01-01

BioData Mining

Abstract:Background Acute heart failure (AHF) is associated with significant morbidity and mortality. Effective patient risk stratification is essential to guiding hospitalization decisions and the clinical management of AHF. Clinical decision support systems can be used to improve predictions of mortality made in emergency care settings for the purpose of AHF risk stratification. In this study, several models for the prediction of seven-day mortality among AHF patients were developed by applying machine learning techniques to retrospective patient data from 236,275 total emergency department (ED) encounters, 1881 of which were considered positive for AHF and were used for model training and testing. The models used varying subsets of age, sex, vital signs, and laboratory values. Model performance was compared to the Emergency Heart Failure Mortality Risk Grade (EHMRG) model, a commonly used system for prediction of seven-day mortality in the ED with similar (or, in some cases, more extensive) inputs. Model performance was assessed in terms of area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity. Results When trained and tested on a large academic dataset, the best-performing model and EHMRG demonstrated test set AUROCs of 0.84 and 0.78, respectively, for prediction of seven-day mortality. Given only measurements of respiratory rate, temperature, mean arterial pressure, and FiO(2), one model produced a test set AUROC of 0.83. Neither a logistic regression comparator nor a simple decision tree outperformed EHMRG. Conclusions A model using only the measurements of four clinical variables outperforms EHMRG in the prediction of seven-day mortality in AHF. With these inputs, the model could not be replaced by logistic regression or reduced to a simple decision tree without significant performance loss. In ED settings, this minimal-input risk stratification tool may assist clinicians in making critical decisions about patient disposition by providing early and accurate insights into individual patient's risk profiles.
Improving Cardiovascular Risk Prediction Through Machine Learning Modelling of Irregularly Repeated Electronic Health Records

Chaiquan Li,Xiaofei Liu,Peng Shen,Yexiang Sun,Tianjing Zhou,Weiye Chen,Qi Chen,Hongbo Lin,Xun Tang,Pei Gao

DOI: https://doi.org/10.1093/ehjdh/ztad058

2024-01-01

European Heart Journal - Digital Health

Abstract:Aims:Existing electronic health records (EHRs) often consist of abundant but irregular longitudinal measurements of risk factors. In this study, we aim to leverage such data to improve the risk prediction of atherosclerotic cardiovascular disease (ASCVD) by applying machine learning (ML) algorithms, which can allow automatic screening of the population. Methods and results:A total of 215 744 Chinese adults aged between 40 and 79 without a history of cardiovascular disease were included (6081 cases) from an EHR-based longitudinal cohort study. To allow interpretability of the model, the predictors of demographic characteristics, medication treatment, and repeatedly measured records of lipids, glycaemia, obesity, blood pressure, and renal function were used. The primary outcome was ASCVD, defined as non-fatal acute myocardial infarction, coronary heart disease death, or fatal and non-fatal stroke. The eXtreme Gradient boosting (XGBoost) algorithm and Least Absolute Shrinkage and Selection Operator (LASSO) regression models were derived to predict the 5-year ASCVD risk. In the validation set, compared with the refitted Chinese guideline-recommended Cox model (i.e. the China-PAR), the XGBoost model had a significantly higher C-statistic of 0.792, (the differences in the C-statistics: 0.011, 0.006-0.017, P < 0.001), with similar results reported for LASSO regression (the differences in the C-statistics: 0.008, 0.005-0.011, P < 0.001). The XGBoost model demonstrated the best calibration performance (men: Dx = 0.598, P = 0.75; women: Dx = 1.867, P = 0.08). Moreover, the risk distribution of the ML algorithms differed from that of the conventional model. The net reclassification improvement rates of XGBoost and LASSO over the Cox model were 3.9% (1.4-6.4%) and 2.8% (0.7-4.9%), respectively. Conclusion:Machine learning algorithms with irregular, repeated real-world data could improve cardiovascular risk prediction. They demonstrated significantly better performance for reclassification to identify the high-risk population correctly.
Automatic prediction of mortality in patients with mental illness using electronic health records

Sean Kim,Samuel Kim

2023-10-19

Abstract:Mental disorders impact the lives of millions of people globally, not only impeding their day-to-day lives but also markedly reducing life expectancy. This paper addresses the persistent challenge of predicting mortality in patients with mental diagnoses using predictive machine-learning models with electronic health records (EHR). Data from patients with mental disease diagnoses were extracted from the well-known clinical MIMIC-III data set utilizing demographic, prescription, and procedural information. Four machine learning algorithms (Logistic Regression, Random Forest, Support Vector Machine, and K-Nearest Neighbors) were used, with results indicating that Random Forest and Support Vector Machine models outperformed others, with AUC scores of 0.911. Feature importance analysis revealed that drug prescriptions, particularly Morphine Sulfate, play a pivotal role in prediction. We applied a variety of machine learning algorithms to predict 30-day mortality followed by feature importance analysis. This study can be used to assist hospital workers in identifying at-risk patients to reduce excess mortality.

Machine Learning
A Dynamic Risk-Based Early Warning Monitoring System for Population-Based Management of Cardiovascular Disease

Xiaofei Liu,Qianqian Li,Weiye Chen,Peng Shen,Yexiang Sun,Qi Chen,Jinguo Wu,Jingyi Zhang,Ping Lu,Hongbo Lin,Xun Tang,Pei Gao

DOI: https://doi.org/10.1016/j.fmre.2021.08.008

2021-01-01

Fundamental Research

Abstract:Risk prediction tools are crucial for population-based management of cardiovascular disease (CVD). However, most prediction models are currently used to assess long-term risk instead of the risk of short-term CVD onset. We developed a Dynamic Risk-based Early wArning Monitoring (DREAM) system using large-scale, real-time electronic health record data from 2010 to 2020 from the CHinese Electronic health Records Research in Yinzhou study. The dynamic risk scores were derived from a 1:5 matched nested case–control set comprising 70,470 individuals (11,745 CVD events) and then validated in a cohort of 81,205 individuals (5950 CVD events). The individuals were Chinese adults aged 40–79 years without a history of CVD at baseline. Eleven predictors related to vital signs, laboratory tests, and health service utilization were selected to establish the dynamic scores. The proposed scores were significantly associated with the subsequent CVD onset (adjusted odds ratio, 1.21; 95% confidence interval, 1.20–1.23). The area under the receiver operating characteristic curves (AUCs) was 0.6010 (0.5929–0.6092) and 0.6021 (0.5937–0.6105) for the long-term 10-year CVD risk <10% and ≥10% groups in the derivation set, respectively. In the long-term 10-year CVD risk ≥10% group in the validation set, the change in AUC in addition to the long-term risk was 0.0235 (0.0155–0.0315). By increasing the risk threshold from 7 to 16 points, the proportion of true subsequent CVD cases among those given alerts increased from 40.61% to 85.31%. In terms of management efficiency, the number needed to manage per CVD case ranged from 2.46 to 1.17 using the risk scores. With the increasing popularity and integration of EHR systems with wearable technology, the DREAM scores can be incorporated into an early-warning system and applied in dynamic, real-time, EHR-based, automated management to support healthcare decision making for individuals, general practitioners, and policymakers.
In-hospital mortality, readmission, and prolonged length of stay risk prediction leveraging historical electronic patient records

Rajeev Bopche,Lise Tuset Gustad,Jan Egil Afset,Birgitta Ehrnström,Jan Kristian Damås,Øystein Nytrø

DOI: https://doi.org/10.1093/jamiaopen/ooae074

2024-09-14

JAMIA Open

Abstract:Objective: This study aimed to investigate the predictive capabilities of historical patient records to predict patient adverse outcomes such as mortality, readmission, and prolonged length of stay (PLOS). Methods: Leveraging a de-identified dataset from a tertiary care university hospital, we developed an eXplainable Artificial Intelligence (XAI) framework combining tree-based and traditional machine learning (ML) models with interpretations and statistical analysis of predictors of mortality, readmission, and PLOS. Results: Our framework demonstrated exceptional predictive performance with a notable area under the receiver operating characteristic (AUROC) of 0.9625 and an area under the precision-recall curve (AUPRC) of 0.8575 for 30-day mortality at discharge and an AUROC of 0.9545 and AUPRC of 0.8419 at admission. For the readmission and PLOS risk, the highest AUROC achieved were 0.8198 and 0.9797, respectively. The tree-based models consistently outperformed the traditional ML models in all 4 prediction tasks. The key predictors were age, derived temporal features, routine laboratory tests, and diagnostic and procedural codes. Conclusion: The study underscores the potential of leveraging medical history for enhanced hospital predictive analytics. We present an accurate and intuitive framework for early warning models that can be easily implemented in the current and developing digital health platforms to predict adverse outcomes accurately.
Prediction of Left Ventricular Ejection Fraction Changes in Heart Failure Patients Using Machine Learning and Electronic Health Records: a Multi-Site Study.

Prakash Adekkanattu,Luke V. Rasmussen,Jennifer A. Pacheco,Joseph Kabariti,Daniel J. Stone,Yue Yu,Guoqian Jiang,Yuan Luo,Pascal S. Brandt,Zhenxing Xu,Veer Vekaria,Jie Xu,Fei Wang,Natalie C. Benda,Yifan Peng,Parag Goyal,Faraz S. Ahmad,Jyotishman Pathak

DOI: https://doi.org/10.1038/s41598-023-27493-8

IF: 4.6

2023-01-01

Scientific Reports

Abstract:Left ventricular ejection fraction (EF) is a key measure in the diagnosis and treatment of heart failure (HF) and many patients experience changes in EF overtime. Large-scale analysis of longitudinal changes in EF using electronic health records (EHRs) is limited. In a multi-site retrospective study using EHR data from three academic medical centers, we investigated longitudinal changes in EF measurements in patients diagnosed with HF. We observed significant variations in baseline characteristics and longitudinal EF change behavior of the HF cohorts from a previous study that is based on HF registry data. Data gathered from this longitudinal study were used to develop multiple machine learning models to predict changes in ejection fraction measurements in HF patients. Across all three sites, we observed higher performance in predicting EF increase over a 1-year duration, with similarly higher performance predicting an EF increase of 30% from baseline compared to lower percentage increases. In predicting EF decrease we found moderate to high performance with low confidence for various models. Among various machine learning models, XGBoost was the best performing model for predicting EF changes. Across the three sites, the XGBoost model had an F1-score of 87.2, 89.9, and 88.6 and AUC of 0.83, 0.87, and 0.90 in predicting a 30% increase in EF, and had an F1-score of 95.0, 90.6, 90.1 and AUC of 0.54, 0.56, 0.68 in predicting a 30% decrease in EF. Among features that contribute to predicting EF changes, baseline ejection fraction measurement, age, gender, and heart diseases were found to be statistically significant.
Using Electronic Health Record Collected Clinical Variables to Predict Medical Intensive Care Unit Mortality

Jacob Calvert,Qingqing Mao,Jana L. Hoffman,Melissa Jay,Thomas Desautels,Hamid Mohamadlou,Uli Chettipally,Ritankar Das

DOI: https://doi.org/10.1016/j.amsu.2016.09.002

2016-01-01

Annals of Medicine and Surgery

Abstract:Background: Clinical decision support systems are used to help predict patient stability and mortality in the Intensive Care Unit (ICU). Accurate patient information can assist clinicians with patient management and in allocating finite resources. However, systems currently in common use have limited predictive value in the clinical setting. The increasing availability of Electronic Health Records (EHR) provides an opportunity to use medical information for more accurate patient stability and mortality prediction in the ICU.Objective: Develop and evaluate an algorithm which more accurately predicts patient mortality in the ICU, using the correlations between widely available clinical variables from the EHR.Methods: We have developed an algorithm, AutoTriage, which uses eight common clinical variables from the EHR to assign patient mortality risk scores. Each clinical variable produces a subscore, and combinations of two or three discretized clinical variables also produce subscores. A combination of weighted subscores produces the overall score. We validated the performance of this algorithm in a retrospective study on the MIMIC III medical ICU dataset.Results: AutoTriage 12 h mortality prediction yields an Area Under Receiver Operating Characteristic value of 0.88 (95% confidence interval 0.86 to 0.88). At a sensitivity of 80%, AutoTriage maintains a specificity of 81% with a diagnostic odds ratio of 16.26.Conclusions: Through the multidimensional analysis of the correlations between eight common clinical variables, AutoTriage provides an improvement in the specificity and sensitivity of patient mortality prediction over existing prediction methods. (C) 2016 The Authors. Published by Elsevier Ltd on behalf of IJS Publishing Group Ltd.
Predicting short and long-term mortality after acute ischemic stroke using EHR

Vida Abedi,Venkatesh Avula,Seyed-Mostafa Razavi,Shreya Bavishi,Durgesh Chaudhary,Shima Shahjouei,Ming Wang,Christoph J Griessenauer,Jiang Li,Ramin Zand,Christoph J. Griessenauer

DOI: https://doi.org/10.1016/j.jns.2021.117560

IF: 4.4

2021-08-01

Journal of the Neurological Sciences

Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Objective</h3><p>Despite improvements in treatment, stroke remains a leading cause of mortality and long-term disability. In this study, we leveraged administrative data to build predictive models of short- and long-term post-stroke all-cause-mortality.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Methods</h3><p>The study was conducted and reported according to the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) guideline. We used patient-level data from electronic health records, three algorithms, and six prediction windows to develop models for post-stroke mortality.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>We included 7144 patients from which 5347 had survived their ischemic stroke after two years. The proportion of mortality was between 8%(605/7144) within 1-month, to 25%(1797/7144) for the 2-years window. The three most common comorbidities were hypertension, dyslipidemia, and diabetes. The best Area Under the ROC curve(AUROC) was reached with the Random Forest model at 0.82 for the 1-month prediction window. The negative predictive value(NPV) was highest for the shorter prediction windows – 0.91 for the 1-month – and the best positive predictive value(PPV) was reached for the 6-months prediction window at 0.92. Age, hemoglobin levels, and body mass index were the top associated factors. Laboratory variables had higher importance when compared to past medical history and comorbidities. Hypercoagulation state, smoking, and end-stage renal disease were more strongly associated with long-term mortality.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion</h3><p>All the selected algorithms could be trained to predict the short and long-term mortality after stroke. The factors associated with mortality differed depending on the prediction window. Our classifier highlighted the importance of controlling risk factors, as indicated by laboratory measures.</p>

neurosciences,clinical neurology
Predicting 30-Day and 1-Year Mortality in Heart Failure with Preserved Ejection Fraction (HFpEF)

Ikgyu Shin,Nilay Bhatt,Alaa Alashi,Keervani Kandala,Karthik Murugiah

DOI: https://doi.org/10.1101/2024.10.15.24315524

2024-10-16

Abstract:Objectives: To develop and compare prediction models for 30-day and 1-year mortality in Heart failure with preserved ejection fraction (HFpEF) using EHR data, utilizing both traditional and machine learning (ML) techniques. Background: HFpEF represents 1 in 2 heart failure patients. Predictive models in HFpEF, specifically those derived from electronic health record (EHR) data, are less established. Methods: Using MIMIC-IV EHR data from 2008-2019, patients aged ≥ 18 years admitted with a primary diagnosis of HFpEF were identified using ICD-9 and 10 codes. Demographics, vital signs, prior diagnoses, and lab data were extracted. Data was partitioned into 80% training, 20% test sets. Prediction models from seven model classes (Support Vector Classifier (SVC), Logistic Regression, Lasso Regression, Elastic Net, Random Forest, Histogram-based Gradient Boosting Classifier (HGBC), and XGBoost) were developed using various imputation and oversampling techniques with 5-fold cross-validation. Model performance was compared using several metrics, and individual feature importance assessed using SHapley Additive exPlanations (SHAP) analysis. Results: Among 3910 hospitalizations for HFpEF, 30-day mortality was 6.3%, and 1-year mortality was 29.2%. Logistic regression performed well for 30-day mortality (Area Under the Receiver operating characteristic curve (AUC) 0.83), whereas Random Forest (AUC 0.79) and HGBC (AUC 0.78) for 1-year mortality. Age and NT-proBNP were the strongest predictors in SHAP analyses for both outcomes. Conclusion: Models derived from EHR data can predict mortality after HFpEF hospitalization with comparable performance to models derived from registry or trial data, highlighting the potential for clinical implementation.

Cardiovascular Medicine
Short-term Mortality Prediction for Elderly Patients Using Medicare Claims Data

Maggie Makar,Marzyeh Ghassemi,David Cutler,Ziad Obermeyer

DOI: https://doi.org/10.48550/arXiv.1712.00644

IF: 5.414

2017-12-02

Machine Learning

Abstract:Risk prediction is central to both clinical medicine and public health. While many machine learning models have been developed to predict mortality, they are rarely applied in the clinical literature, where classification tasks typically rely on logistic regression. One reason for this is that existing machine learning models often seek to optimize predictions by incorporating features that are not present in the databases readily available to providers and policy makers, limiting generalizability and implementation. Here we tested a number of machine learning classifiers for prediction of six-month mortality in a population of elderly Medicare beneficiaries, using an administrative claims database of the kind available to the majority of health care payers and providers. We show that machine learning classifiers substantially outperform current widely-used methods of risk prediction but only when used with an improved feature set incorporating insights from clinical medicine, developed for this study. Our work has applications to supporting patient and provider decision making at the end of life, as well as population health-oriented efforts to identify patients at high risk of poor outcomes.
Individualized prediction of critical illness in older adults: Validation of an elders risk assessment model

Svetlana Herasevich,Sarah A. Minteer,Christopher L. Boswell,Andrew C. Hanson,Yue Dong,Ognjen Gajic,Amelia K. Barwise

DOI: https://doi.org/10.1111/jgs.18861

2024-03-08

Journal of the American Geriatrics Society

Abstract:Background The electronic health record (EHR) presents new opportunities for the timely identification of patients at high risk of critical illness and the implementation of preventive strategies. This study aims to externally validate an EHR‐based Elders Risk Assessment (ERA) score to identify older patients at high risk of future critical illness during a primary care visit. Methods This historical cohort study included patients aged ≥65 years who had primary care visits at Mayo Clinic Rochester, MN, between July 2019 and December 2021. The ERA score at the time of the primary care visit was used to predict critical illness, defined as death or ICU admission within 1 year of the visit. Results A total of 12,885 patients were included in the analysis. The median age at the time of the primary care visit was 75 years, with 44.6% being male. 93.7% of participants were White, and 64.2% were married. The median (25th, 75th percentile) ERA score was 4 (0, 9). 11.3% of study participants were admitted to the ICU or died within 1 year of the visit. The ERA score predicted critical illness within 1 year of a primary care visit with an area under the receiver operating characteristic curve of 0.84 (95% CI 0.83–0.85), which indicates good discrimination. An ERA score of 9 was identified as optimal for implementing and testing potential preventive strategies, with the odds ratio of having the primary outcome in patients with ERA score ≥9 being 11.33 (95%CI 9.98–12.87). Conclusions This simple EHR‐based risk assessment model can predict critical illness within 1 year of primary care visits in older patients. The findings of this study can serve as a basis for testing and implementation of preventive strategies to promote the well‐being of older adults at risk of critical illness and its consequences.

geriatrics & gerontology,gerontology
Towards artificial intelligence-based learning health system for population-level mortality prediction using electrocardiograms

Weijie Sun,Sunil Vasu Kalmady,Nariman Sepehrvand,Amir Salimi,Yousef Nademi,Kevin Bainey,Justin A. Ezekowitz,Russell Greiner,Abram Hindle,Finlay A. McAlister,Roopinder K. Sandhu,Padma Kaul

DOI: https://doi.org/10.1038/s41746-023-00765-3

IF: 15.2

2023-02-07

npj Digital Medicine

Abstract:The feasibility and value of linking electrocardiogram (ECG) data to longitudinal population-level administrative health data to facilitate the development of a learning healthcare system has not been fully explored. We developed ECG-based machine learning models to predict risk of mortality among patients presenting to an emergency department or hospital for any reason. Using the 12-lead ECG traces and measurements from 1,605,268 ECGs from 748,773 healthcare episodes of 244,077 patients (2007–2020) in Alberta, Canada, we developed and validated ResNet-based Deep Learning (DL) and gradient boosting-based XGBoost (XGB) models to predict 30-day, 1-year, and 5-year mortality. The models for 30-day, 1-year, and 5-year mortality were trained on 146,173, 141,072, and 111,020 patients and evaluated on 97,144, 89,379, and 55,650 patients, respectively. In the evaluation cohort, 7.6%, 17.3%, and 32.9% patients died by 30-days, 1-year, and 5-years, respectively. ResNet models based on ECG traces alone had good-to-excellent performance with area under receiver operating characteristic curve (AUROC) of 0.843 (95% CI: 0.838–0.848), 0.812 (0.808–0.816), and 0.798 (0.792–0.803) for 30-day, 1-year and 5-year prediction, respectively; and were superior to XGB models based on ECG measurements with AUROC of 0.782 (0.776–0.789), 0.784 (0.780–0.788), and 0.746 (0.740–0.751). This study demonstrates the validity of ECG-based DL mortality prediction models at the population-level that can be leveraged for prognostication at point of care.

health care sciences & services,medical informatics
Longitudinal Cohorts for Harnessing the Electronic Health Record for Disease Prediction in a US Population.

Sheila M. Manemann,Jennifer L. St Sauver,Hongfang Liu,Nicholas B. Larson,Sungrim Moon,Paul Y. Takahashi,Janet E. Olson,Walter A. Rocca,Virginia M. Miller,Terry M. Therneau,Che G. Ngufor,Veronique L. Roger,Yiqing Zhao,Paul A. Decker,Jill M. Killian,Suzette J. Bielinski

DOI: https://doi.org/10.1136/bmjopen-2020-044353

IF: 3.006

2021-01-01

BMJ Open

Abstract:PURPOSE:The depth and breadth of clinical data within electronic health record (EHR) systems paired with innovative machine learning methods can be leveraged to identify novel risk factors for complex diseases. However, analysing the EHR is challenging due to complexity and quality of the data. Therefore, we developed large electronic population-based cohorts with comprehensive harmonised and processed EHR data.PARTICIPANTS:All individuals 30 years of age or older who resided in Olmsted County, Minnesota on 1 January 2006 were identified for the discovery cohort. Algorithms to define a variety of patient characteristics were developed and validated, thus building a comprehensive risk profile for each patient. Patients are followed for incident diseases and ageing-related outcomes. Using the same methods, an independent validation cohort was assembled by identifying all individuals 30 years of age or older who resided in the largely rural 26-county area of southern Minnesota and western Wisconsin on 1 January 2013.FINDINGS TO DATE:For the discovery cohort, 76 255 individuals (median age 49; 53% women) were identified from which a total of 9 644 221 laboratory results; 9 513 840 diagnosis codes; 10 924 291 procedure codes; 1 277 231 outpatient drug prescriptions; 966 136 heart rate measurements and 1 159 836 blood pressure (BP) measurements were retrieved during the baseline time period. The most prevalent conditions in this cohort were hyperlipidaemia, hypertension and arthritis. For the validation cohort, 333 460 individuals (median age 54; 52% women) were identified and to date, a total of 19 926 750 diagnosis codes, 10 527 444 heart rate measurements and 7 356 344 BP measurements were retrieved during baseline.FUTURE PLANS:Using advanced machine learning approaches, these electronic cohorts will be used to identify novel sex-specific risk factors for complex diseases. These approaches will allow us to address several challenges with the use of EHR.
Predicting Out-of-Hospital Cardiac Arrest in the General Population Using Electronic Health Records

Jessica Perry,Jennifer A Brody,Christine Fong,Jacob E Sunshine,Vikas N O'Reilly-Shah,Michael R Sayre,Thomas D Rea,Noah Simon,Ali Shojaie,Nona Sotoodehnia,Neal A Chatterjee

DOI: https://doi.org/10.1161/CIRCULATIONAHA.124.069105

IF: 37.8

2024-07-09

Circulation

Abstract:Background: The majority of out-of-hospital cardiac arrests (OHCAs) occur among individuals in the general population, for whom there is no established strategy to identify risk. In this study, we assess the use of electronic health record (EHR) data to identify OHCA in the general population and define salient factors contributing to OHCA risk. Methods: The analytical cohort included 2366 individuals with OHCA and 23 660 age- and sex-matched controls receiving health care at the University of Washington. Comorbidities, electrocardiographic measures, vital signs, and medication prescription were abstracted from the EHR. The primary outcome was OHCA. Secondary outcomes included shockable and nonshockable OHCA. Model performance including area under the receiver operating characteristic curve and positive predictive value were assessed and adjusted for observed rate of OHCA across the health system. Results: There were significant differences in demographic characteristics, vital signs, electrocardiographic measures, comorbidities, and medication distribution between individuals with OHCA and controls. In external validation, discrimination in machine learning models (area under the receiver operating characteristic curve 0.80-0.85) was superior to a baseline model with conventional cardiovascular risk factors (area under the receiver operating characteristic curve 0.66). At a specificity threshold of 99%, correcting for baseline OHCA incidence across the health system, positive predictive value was 2.5% to 3.1% in machine learning models compared with 0.8% for the baseline model. Longer corrected QT interval, substance abuse disorder, fluid and electrolyte disorder, alcohol abuse, and higher heart rate were identified as salient predictors of OHCA risk across all machine learning models. Established cardiovascular risk factors retained predictive importance for shockable OHCA, but demographic characteristics (minority race, single marital status) and noncardiovascular comorbidities (substance abuse disorder) also contributed to risk prediction. For nonshockable OHCA, a range of salient predictors, including comorbidities, habits, vital signs, demographic characteristics, and electrocardiographic measures, were identified. Conclusions: In a population-based case-control study, machine learning models incorporating readily available EHR data showed reasonable discrimination and risk enrichment for OHCA in the general population. Salient factors associated with OCHA risk were myriad across the cardiovascular and noncardiovascular spectrum. Public health and tailored strategies for OHCA prediction and prevention will require incorporation of this complexity.
Early Prediction of Alzheimer's Disease and Related Dementias Using Real-World Electronic Health Records.

Qian Li,Xi Yang,Jie Xu,Yi Guo,Xing He,Hui Hu,Tianchen Lyu,David Marra,Amber Miller,Glenn Smith,Steven DeKosky,Richard D. Boyce,Karen Schliep,Elizabeth Shenkman,Demetrius Maraganore,Yonghui Wu,Jiang Bian

DOI: https://doi.org/10.1002/alz.12967

2023-01-01

Abstract:INTRODUCTION:This study aims to explore machine learning (ML) methods for early prediction of Alzheimer's disease (AD) and related dementias (ADRD) using the real-world electronic health records (EHRs).METHODS:A total of 23,835 ADRD and 1,038,643 control patients were identified from the OneFlorida+ Research Consortium. Two ML methods were used to develop the prediction models. Both knowledge-driven and data-driven approaches were explored. Four computable phenotyping algorithms were tested.RESULTS:The gradient boosting tree (GBT) models trained with the data-driven approach achieved the best area under the curve (AUC) scores of 0.939, 0.906, 0.884, and 0.854 for early prediction of ADRD 0, 1, 3, or 5 years before diagnosis, respectively. A number of important clinical and sociodemographic factors were identified.DISCUSSION:We tested various settings and showed the predictive ability of using ML approaches for early prediction of ADRD with EHRs. The models can help identify high-risk individuals for early informed preventive or prognostic clinical decisions.
Using Machine Learning and Electronic Health Record (EHR) Data for the Early Prediction of Alzheimer's Disease and Related Dementias.

Sonia Akter,Zhandi Liu,Eduardo Simoes,Praveen Rao

DOI: https://doi.org/10.1101/2024.12.09.24318740

2024-12-10

Abstract:Objective: In the United States, over 6 million patients are affected by Alzheimer's Disease and Related Dementias (ADRD). The study aims to develop and validate machine learning (ML) models for the early diagnosis and prediction of ADRD using de-identified Electronic Health Record (EHR) data from the University of Missouri (MU) Healthcare for different prediction windows. Materials and Methods: The study used de-identified EHR data provided by the MU NextGen Biomedical Informatics (BMI). An initial cohort of 380,269 patients aged over 40 with at least two healthcare encounters was narrowed to a final dataset of 4,012 unique patients of ADRD cases and 119,723 unique patients of controls. We trained and evaluated six different ML classifier models: Gradient-Boosted Trees (GBT), Light Gradient-Boosting Machine (LightGBM), Random Forest (RF), eXtreme Gradient-Boosting (XGBoost), Logistic Regression (LR), and Adaptive Boosting (AdaBoost) using metrics such as Area Under the Receiver Operating Characteristic Curve (AUC-ROC) score, accuracy, sensitivity, specificity, and F1 score. SHAP (SHapley Additive exPlanations) analysis was used to interpret predictions. Results: The GBT model achieved the best AUC-ROC scores of 0.809, 0.821, 0.822, 0.808, and 0.833 for 1-year, 2-year, 3-year, 4-year, and 5-year prediction windows, respectively. The SHAP analysis highlighted key risk factors for ADRD, including depressive disorder, heart disease, higher age, headache, anxiety, and insomnia. Conclusion: This study demonstrates the potential of ML models using EHR data for early ADRD prediction, enabling timely interventions to delay progression and improve outcomes. These findings offer insights for future research and proactive care strategies.
Risk prediction of heart diseases in patients with breast cancer: A deep learning approach with longitudinal electronic health records data

Sicheng Zhou,Anne Blaes,Chetan Shenoy,Ju Sun,Rui Zhang

DOI: https://doi.org/10.1016/j.isci.2024.110329

IF: 5.8

2024-06-20

iScience

Abstract:Accurately predicting heart disease risks in patients with breast cancer is crucial for clinical decision support and patient safety. This study developed and evaluated predictive models for six heart diseases using real-world electronic health records (EHRs) data. We incorporated a trainable decay mechanism to handle missing values in the long short-term memory (LSTM) model, creating LSTM-D models to predict heart disease risk based on longitudinal EHRs data. Additionally, we deployed NLP methods to extract breast cancer phenotypes from clinical texts, integrating unstructured and structured data to enhance predictions. Our LSTM-D models outperformed baseline models in predicting congestive heart failure, coronary artery disease, cardiomyopathy, myocardial infarction, transient ischemic attack, and aortic regurgitation, with AUC scores ranging from 0.7189 to 0.9548. Observation windows of 12-24 months were found optimal for model performance. This research advances precise, personalized care strategies, enabling early intervention and improved management of cardiovascular risks in breast cancer survivors.

Using Electronic Medical Records to Predict Mortality in Primary Care Patients with Heart Disease

Assessing Statewide All-Cause Future One-Year Mortality: Prospective Study With Implications for Quality of Life, Resource Utilization, and Medical Futility.

A Method for the Early Prediction of Chronic Diseases Based on Short Sequential Medical Data.

Using Primary Health Care Electronic Medical Records to Predict Hospitalizations, Emergency Department Visits, and Mortality: A Systematic Review

Prediction of Short-Term Mortality in Acute Heart Failure Patients Using Minimal Electronic Health Record Data

Improving Cardiovascular Risk Prediction Through Machine Learning Modelling of Irregularly Repeated Electronic Health Records

Automatic prediction of mortality in patients with mental illness using electronic health records

A Dynamic Risk-Based Early Warning Monitoring System for Population-Based Management of Cardiovascular Disease

In-hospital mortality, readmission, and prolonged length of stay risk prediction leveraging historical electronic patient records

Prediction of Left Ventricular Ejection Fraction Changes in Heart Failure Patients Using Machine Learning and Electronic Health Records: a Multi-Site Study.

Using Electronic Health Record Collected Clinical Variables to Predict Medical Intensive Care Unit Mortality

Predicting short and long-term mortality after acute ischemic stroke using EHR

Predicting 30-Day and 1-Year Mortality in Heart Failure with Preserved Ejection Fraction (HFpEF)

Short-term Mortality Prediction for Elderly Patients Using Medicare Claims Data

Individualized prediction of critical illness in older adults: Validation of an elders risk assessment model

Towards artificial intelligence-based learning health system for population-level mortality prediction using electrocardiograms

Longitudinal Cohorts for Harnessing the Electronic Health Record for Disease Prediction in a US Population.

Predicting Out-of-Hospital Cardiac Arrest in the General Population Using Electronic Health Records

Early Prediction of Alzheimer's Disease and Related Dementias Using Real-World Electronic Health Records.

Using Machine Learning and Electronic Health Record (EHR) Data for the Early Prediction of Alzheimer's Disease and Related Dementias.

Risk prediction of heart diseases in patients with breast cancer: A deep learning approach with longitudinal electronic health records data