A comparison of random survival forest and Cox regression for prediction of mortality in patients with hemorrhagic stroke

Yuxin Wang,Yuhan Deng,Yinliang Tan,Meihong Zhou,Yong Jiang,Baohua Liu

DOI: https://doi.org/10.1186/s12911-023-02293-2

IF: 3.298

2023-10-15

BMC Medical Informatics and Decision Making

Abstract:To evaluate RSF and Cox models for mortality prediction of hemorrhagic stroke (HS) patients in intensive care unit (ICU).

medical informatics

What problem does this paper attempt to address?

Comparison of Machine Learning Models and Framingham Risk Score for the prediction of the presence and severity of Coronary Artery Diseases by using Gensini Score

Yao Wang,Kangjun Zhu,Ya Li,Liding Zhao,Qingbo Lv,Guosheng Fu,Wenbin Zhang

DOI: https://doi.org/10.21203/rs.2.12128/v1

2019-01-01

Abstract:Abstract Background: The risk prediction model for cardiovascular conditions based on the routine information isn’t established. Machine Learning (ML) models offered opportunities to build a promising and accurate prediction system for the presence and severity of Coronary Artery Diseases (CAD). Methods: In order to compare the validation of ML models to Framingham Risk Score (FRS), a total of 2608 inpatients (1669 men, 939 women; mean age 63.16 ± 10.72 years) at our hospital from January 2015 to July 2017 were extracted from electronic medical system with 29 attributes. Four different ML algorithms (Logistic Regression (LR), Random Forest (RF), k-Nearest Neighbors (KNN), Artificial Neural Networks (ANN)) were acted to build models, based on eight core risk factors and all factors respectively. The Area Under Curve (AUC) of receiver operating characteristic curve was the significant value to show the prediction power for different models. Results: According to the AUC, all of ML algorithms had a better prediction validation than FRS for the presence of CAD, specifically, FRS
Individual risk prediction: Comparing random forests with Cox proportional‐hazards model by a simulation study

Valia Baralou,Natasa Kalpourtzi,Giota Touloumi

DOI: https://doi.org/10.1002/bimj.202100380

IF: 1.715

2022-10-01

Biometrical Journal

Abstract:With big data becoming widely available in healthcare, machine learning algorithms such as random forest (RF) that ignores time‐to‐event information and random survival forest (RSF) that handles right‐censored data are used for individual risk prediction alternatively to the Cox proportional hazards (Cox‐PH) model. We aimed to systematically compare RF and RSF with Cox‐PH. RSF with three split criteria [log‐rank (RSF‐LR), log‐rank score (RSF‐LRS), maximally selected rank statistics (RSF‐MSR)]; RF, Cox‐PH, and Cox‐PH with splines (Cox‐S) were evaluated through a simulation study based on real data. One hundred eighty scenarios were investigated assuming different associations between the predictors and the outcome (linear/linear and interactions/nonlinear/nonlinear and interactions), training sample sizes (500/1000/5000), censoring rates (50%/75%/93%), hazard functions (increasing/decreasing/constant), and number of predictors (seven, 15 including noise variables). Methods' performance was evaluated with time‐dependent area under curve and integrated Brier score. In all scenarios, RF had the worst performance. In scenarios with a low number of events (⩽70), Cox‐PH was at least noninferior to RSF, whereas under linearity assumption it outperformed RSF. Under the presence of interactions, RSF performed better than Cox‐PH as the number of events increased whereas Cox‐S reached at least similar performance with RSF under nonlinear effects. RSF‐LRS performed slightly worse than RSF‐LR and RSF‐MSR when including noise variables and interaction effects. When applied to real data, models incorporating survival time performed better. Although RSF algorithms are a promising alternative to conventional Cox‐PH as data complexity increases, they require a higher number of events for training. In time‐to‐event analysis, algorithms that consider survival time should be used.

mathematical & computational biology,statistics & probability
Risk Prediction Model for In-Hospital Mortality in Women with ST-elevation Myocardial Infarction: A Machine Learning Approach

Hend Mansoor,Islam Y. Elgendy,Richard Segal,Anthony A. Bavry,Jiang Bian

DOI: https://doi.org/10.1016/j.hrtlng.2017.09.003

IF: 24

2017-01-01

Journal of the American College of Cardiology

Abstract:Background: Studies had shown that mortality due to ST-elevation myocardial infarction (STEMI) is higher in women compared with men. The purpose of this study is to develop and validate prediction models for all-cause in-hospital mortality in women admitted with STEMI using logistic regression and random forest, and to compare the performance and validity of the different models. Methods: Data from the National Inpatient Sample (NIS) data years 2011-2013 were used to identify women admitted with STEMI. The main outcome was all-cause in-hospital mortality. Patients were divided into development and validation cohorts, and trained models were internally validated using 20% of the 2012 data, and externally validated using 2011 and 2013 NIS data. Results: Three main models were developed and compared; multivariate logistic regression, full and reduced random forest models. In the multivariate logistic regression, 11 variables were included in the final model based on backward elimination. The full random forest model contained 32 variables, and the reduced model contained 17 variables selected based on individual variable importance. In the internal validation cohort, the C-index was 0.84, 0.81, and 0.80 for the multivariate logistic regression, full, and reduced random forest models, respectively. The models showed good stability in the external validation cohorts with a C-index for the logistic regression, full, and reduced random forest models of 0.84, 0.85, and 0.81 for year 2011, and 0.82, 0.81, and 0.81 for year 2013, respectively. Conclusions: Random forest was comparable to logistic regression in predicting in-hospital mortality in women with STEMI, and can be a useful and accurate tool in clinical practice. (C) 2017 Elsevier Inc. All rights reserved.
Novel head and neck cancer survival analysis approach: Random survival forests versus cox proportional hazards regression

Frank R. Datema,Ana Moya,Peter Krause,Thomas Bäck,Lars Willmes,Ton Langeveld,Robert J. Baatenburg de Jong,Henk M. Blom

DOI: https://doi.org/10.1002/hed.21698

2011-02-14

Head and Neck

Abstract:BACKGROUND: Electronic patient files generate an enormous amount of medical data. These data can be used for research, such as prognostic modeling. Automatization of statistical prognostication processes allows automatic updating of models when new data is gathered. The increase of power behind an automated prognostic model makes its predictive capability more reliable. Cox proportional hazard regression is most frequently used in prognostication. Automatization of a Cox model is possible, but we expect the updating process to be time-consuming. A possible solution lies in an alternative modeling technique called random survival forests (RSFs). RSF is easily automated and is known to handle the proportionality assumption coherently and automatically. Performance of RSF has not yet been tested on a large head and neck oncological dataset. This study investigates performance of head and neck overall survival of RSF models. Performances are compared to a Cox model as the "gold standard." RSF might be an interesting alternative modeling approach for automatization when performances are similar.METHODS: RSF models were created in R (Cox also in SPSS). Four RSF splitting rules were used: log-rank, conservation of events, log-rank score, and log-rank approximation. Models were based on historical data of 1371 patients with primary head-and-neck cancer, diagnosed between 1981 and 1998. Models contain 8 covariates: tumor site, T classification, N classification, M classification, age, sex, prior malignancies, and comorbidity. Model performances were determined by Harrell's concordance error rate, in which 33% of the original data served as a validation sample.RESULTS: RSF and Cox models delivered similar error rates. The Cox model performed slightly better (error rate, 0.2826). The log-rank splitting approach gave the best RSF performance (error rate, 0.2873). In accord with Cox and RSF models, high T classification, high N classification, and severe comorbidity are very important covariates in the model, whereas sex, mild comorbidity, and a supraglottic larynx tumor are less important. A discrepancy arose regarding the importance of M1 classification (see Discussion).CONCLUSION: Both approaches delivered similar error rates. The Cox model gives a clinically understandable output on covariate impact, whereas RSF becomes more of a "black box." RSF complements the Cox model by giving more insight and confidence toward relative importance of model covariates. RSF can be recommended as the approach of choice in automating survival analyses.
Random Forest-Based Prediction of Stroke Outcome

Carlos Fernandez-Lozano,Pablo Hervella,Virginia Mato-Abad,Manuel Rodriguez-Yanez,Sonia Suarez-Garaboa,Iria Lopez-Dequidt,Ana Estany-Gestal,Tomas Sobrino,Francisco Campos,Jose Castillo,Santiago Rodriguez-Yanez,Ramon Iglesias-Rey

DOI: https://doi.org/10.1038/s41598-021-89434-7

2024-02-01

Abstract:We research into the clinical, biochemical and neuroimaging factors associated with the outcome of stroke patients to generate a predictive model using machine learning techniques for prediction of mortality and morbidity 3 months after admission. The dataset consisted of patients with ischemic stroke (IS) and non-traumatic intracerebral hemorrhage (ICH) admitted to Stroke Unit of a European Tertiary Hospital prospectively registered. We identified the main variables for machine learning Random Forest (RF), generating a predictive model that can estimate patient mortality/morbidity. In conclusion, machine learning algorithms RF can be effectively used in stroke patients for long-term outcome prediction of mortality and morbidity.

Machine Learning
Comparison and use of explainable machine learning-based survival models for heart failure patients

Tao Shi,Jianping Yang,Ningli Zhang,Wei Rong,Lusha Gao,Ping Xia,Jie Zou,Na Zhu,Fazhi Yang,Lixing Chen

DOI: https://doi.org/10.1177/20552076241277027

2024-08-25

Abstract:Objective: Explainable machine learning (XAI) was introduced in this study to improve the interpretability, explainability and transparency of the modelling results. The survex package in R was used to interpret and compare two survival models - the Cox proportional hazards regression (coxph) model and the random survival forest (rfsrc) model - and to estimate overall survival (OS) and its determinants in heart failure (HF) patients using these models. Methods: We selected 1159 HF patients hospitalised at the First Affiliated Hospital of Kunming Medical University. First, the performance of the two models was investigated using the C-index, the integrated C/D AUC, and the integrated Brier score. Second, a global explanation of the whole cohort was carried out using the time-dependent variable importance and the partial dependence survival profile. Finally, the SurvSHAP(t) and SurvLIME plots and the ceteris paribus survival profile were used to obtain a local explanation for each patient. Results: By comparing the C-index, the C/D AUC, and the Brier score, this study showed that the model performance of rfsrc was better than coxph. The global explanation of the whole cohort suggests that the C-reactive protein, lg BNP (brain natriuretic peptide), estimated glomerular filtration rate, albumin, age and blood chloride were significant unfavourable predictors of OS in HF patients in both the cxoph and the rfsrc models. By including individual patients in the model, we can provide a local explanation for each patient, which guides the clinician in individualising the patient's treatment. Conclusion: By comparison, we conclude that the model performance of rfsrc is better than that of coxph. These two predictive models, which address not only the whole population but also selected patients, can help clinicians personalise the treatment of each HF patient according to his or her specific situation.
Causative Classification of Ischemic Stroke by the Machine Learning Algorithm Random Forests

Jianan Wang,Xiaoxian Gong,Hongfang Chen,Wansi Zhong,Yi Chen,Ying Zhou,Wenhua Zhang,Yaode He,Min Lou

DOI: https://doi.org/10.3389/fnagi.2022.788637

IF: 4.8

2022-01-01

Frontiers in Aging Neuroscience

Abstract:Background Prognosis, recurrence rate, and secondary prevention strategies differ by different etiologies in acute ischemic stroke. However, identifying its cause is challenging. Objective This study aimed to develop a model to identify the cause of stroke using machine learning (ML) methods and test its accuracy. Methods We retrospectively reviewed the data of patients who had determined etiology defined by the Trial of ORG 10172 in Acute Stroke Treatment (TOAST) from CASE-II (NCT04487340) to train and evaluate six ML models, namely, Random Forests (RF), Logistic Regression (LR), Extreme Gradient Boosting (XGBoost), K-Nearest Neighbor (KNN), Ada Boosting, Gradient Boosting Machine (GBM), for the detection of cardioembolism (CE), large-artery atherosclerosis (LAA), and small-artery occlusion (SAO). Between October 2016 and April 2020, patients were enrolled consecutively for algorithm development (phase one). Between June 2020 and December 2020, patients were enrolled consecutively in a test set for algorithm test (phase two). Area under the curve (AUC), precision, recall, accuracy, and F1 score were calculated for the prediction model. Results Finally, a total of 18,209 patients were enrolled in phase one, including 13,590 patients (i.e., 6,089 CE, 4,539 LAA, and 2,962 SAO) in the model, and a total of 3,688 patients were enrolled in phase two, including 3,070 patients (i.e., 1,103 CE, 1,269 LAA, and 698 SAO) in the model. Among the six models, the best models were RF, XGBoost, and GBM, and we chose the RF model as our final model. Based on the test set, the AUC values of the RF model to predict CE, LAA, and SAO were 0.981 (95%CI, 0.978–0.986), 0.919 (95%CI, 0.911–0.928), and 0.918 (95%CI, 0.908–0.927), respectively. The most important items to identify CE, LAA, and SAO were atrial fibrillation and degree of stenosis of intracranial arteries. Conclusion The proposed RF model could be a useful diagnostic tool to help neurologists categorize etiologies of stroke. Clinical Trial Registration [www.ClinicalTrials.gov], identifier [NCT01274117].
A New Random Forest Algorithm-Based Prediction Model of Post-operative Mortality in Geriatric Patients With Hip Fractures

Fei Xing,Rong Luo,Ming Liu,Zongke Zhou,Zhou Xiang,Xin Duan

DOI: https://doi.org/10.3389/fmed.2022.829977

IF: 3.9

2022-05-11

Frontiers in Medicine

Abstract:Background Post-operative mortality risk assessment for geriatric patients with hip fractures (HF) is a challenge for clinicians. Early identification of geriatric HF patients with a high risk of post-operative death is helpful for early intervention and improving clinical prognosis. However, a single significant risk factor of post-operative death cannot accurately predict the prognosis of geriatric HF patients. Therefore, our study aims to utilize a machine learning approach, random forest algorithm, to fabricate a prediction model for post-operative death of geriatric HF patients. Methods This retrospective study enrolled consecutive geriatric HF patients who underwent treatment for surgery. The study cohort was divided into training and testing datasets at a 70:30 ratio. The random forest algorithm selected or excluded variables according to the feature importance. Least absolute shrinkage and selection operator (Lasso) was utilized to compare feature selection results of random forest. The confirmed variables were used to create a simplified model instead of a full model with all variables. The prediction model was then verified in the training dataset and testing dataset. Additionally, a prediction model constructed by logistic regression was used as a control to evaluate the efficiency of the new prediction model. Results Feature selection by random forest algorithm and Lasso regression demonstrated that seven variables, including age, time from injury to surgery, chronic obstructive pulmonary disease (COPD), albumin, hemoglobin, history of malignancy, and perioperative blood transfusion, could be used to predict the 1-year post-operative mortality. The area under the curve (AUC) of the random forest algorithm-based prediction model in training and testing datasets were 1.000, and 0.813, respectively. While the prediction tool constructed by logistic regression in training and testing datasets were 0.895, and 0.797, respectively. Conclusions Compared with logistic regression, the random forest algorithm-based prediction model exhibits better predictive ability for geriatric HF patients with a high risk of death within post-operative 1 year.

medicine, general & internal
The comparisons of random survival forests and Cox regression analysis with simulation and an application related to breast cancer

Imran Kurt Omurlu,Mevlut Ture,Füsun Tokatli

DOI: https://doi.org/10.1016/j.eswa.2008.10.023

IF: 8.5

2009-05-01

Expert Systems with Applications

Abstract:The objective of this study was to compare the performances of Cox regression analysis (CRA) and random survival forests (RSF) methods with simulation and a real data set related to breast cancer. In the simulations, we compared across the methods under varying sample sizes by using Monte Carlo simulation method. The results showed that the performance of the CRA was a slightly better for analysis based on Harrell’s concordance index than RSF approaches based on log-rank, conservation of events, log-rank score and approximate log-rank splitting rules. In the real data application, a retrospective analysis was performed in 279 breast cancer patients diagnosed. According to Harrell’s concordance index, RSF based on approximate log-rank splitting rule to determined major risk factors for disease-free survival (DFS) showed a slightly better performance than other approaches. In general, performances of all the methods were almost similar. The predictive capability of CRA can be used for different sample sizes and potential future suitable survival data problems, whereas RSF provide interpretive results.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Prediction of prognosis in elderly patients with sepsis based on machine learning (random survival forest)

Luming Zhang,Tao Huang,Fengshuo Xu,Shaojin Li,Shuai Zheng,Jun Lyu,Haiyan Yin

DOI: https://doi.org/10.1186/s12873-022-00582-z

2022-02-11

BMC Emergency Medicine

Abstract:Abstract Background Elderly patients with sepsis have many comorbidities, and the clinical reaction is not obvious. Thus, clinical treatment is difficult. We planned to use the laboratory test results and comorbidities of elderly patients with sepsis from a large-scale public database Medical Information Mart for Intensive Care (MIMIC) IV to build a random survival forest (RSF) model and to evaluate the model’s predictive value for these patients. Methods Clinical information of elderly patients with sepsis in MIMIC IV database was collected retrospectively. Machine learning (RSF) was used to select the top 30 variables in the training cohort to build the final RSF model. The model was compared with the traditional scoring systems SOFA, SAPSII, and APSIII. The performance of the model was evaluated by C index and calibration curve. Results A total of 6,503 patients were enrolled in the study. The top 30 important variables screened by RSF were used to construct the final RSF model. The new model provided a better C-index (0.731 in the validation cohort). The calibration curve described the agreement between the predicted probability of RSF model and the observed 30-day survival. Conclusions We constructed a prognostic model to predict a 30-day mortality risk in elderly patients with sepsis based on machine learning (RSF algorithm), and it proved superior to the traditional scoring systems. The risk factors affecting the patients were also ranked. In addition to the common risk factors of vasopressors, ventilator use, and urine output. Newly added factors such as RDW, type of ICU unit, malignant cancer, and metastatic solid tumor also significantly influence prognosis.

emergency medicine
Mortality prediction and influencing factors for intensive care unit patients with acute tubular necrosis: random survival forest and cox regression analysis

Jinping Zeng,Min Zhang,Jiaolan Du,Junde Han,Qin Song,Ting Duan,Jun Yang,Yinyin Wu

DOI: https://doi.org/10.3389/fphar.2024.1361923

IF: 5.6

2024-05-24

Frontiers in Pharmacology

Abstract:Background: Patients with acute tubular necrosis (ATN) not only have severe renal failure, but also have many comorbidities, which can be life-threatening and require timely treatment. Identifying the influencing factors of ATN and taking appropriate interventions can effectively shorten the duration of the disease to reduce mortality and improve patient prognosis. Methods: Mortality prediction models were constructed by using the random survival forest (RSF) algorithm and the Cox regression. Next, the performance of both models was assessed by the out-of-bag (OOB) error rate, the integrated brier score, the prediction error curve, and area under the curve (AUC) at 30, 60 and 90 days. Finally, the optimal prediction model was selected and the decision curve analysis and nomogram were established. Results : RSF model was constructed under the optimal combination of parameters (mtry = 10, nodesize = 88). Vasopressors, international normalized ratio (INR)_min, chloride_max, base excess_min, bicarbonate_max, anion gap_min, and metastatic solid tumor were identified as risk factors that had strong influence on mortality in ATN patients. Uni-variate and multivariate regression analyses were used to establish the Cox regression model. Nor-epinephrine, vasopressors, INR_min, severe liver disease, and metastatic solid tumor were identified as important risk factors. The discrimination and calibration ability of both predictive models were demonstrated by the OOB error rate and the integrated brier score. However, the prediction error curve of Cox regression model was consistently lower than that of RSF model, indicating that Cox regression model was more stable and reliable. Then, Cox regression model was also more accurate in predicting mortality of ATN patients based on the AUC at different time points (30, 60 and 90 days). The analysis of decision curve analysis shows that the net benefit range of Cox regression model at different time points is large, indicating that the model has good clinical effectiveness. Finally, a nomogram predicting the risk of death was created based on Cox model. Conclusion: The Cox regression model is superior to the RSF algorithm model in predicting mortality of patients with ATN. Moreover, the model has certain clinical utility, which can provide clinicians with some reference basis in the treatment of ATN and contribute to improve patient prognosis.

pharmacology & pharmacy
Mortality Prediction in Cerebral Hemorrhage Patients Using Machine Learning Algorithms in Intensive Care Units

Ximing Nie,Yuan Cai,Jingyi Liu,Xiran Liu,Jiahui Zhao,Zhonghua Yang,Miao Wen,Liping Liu

DOI: https://doi.org/10.3389/fneur.2020.610531

IF: 3.4

2021-01-20

Frontiers in Neurology

Abstract:Objectives: This study aims to investigate whether the machine learning algorithms could provide an optimal early mortality prediction method compared with other scoring systems for patients with cerebral hemorrhage in intensive care units in clinical practice. Methods: Between 2008 and 2012, from Intensive Care III (MIMIC-III) database, all cerebral hemorrhage patients monitored with the MetaVision system and admitted to intensive care units were enrolled in this study. The calibration, discrimination, and risk classification of predicted hospital mortality based on machine learning algorithms were assessed. The primary outcome was hospital mortality. Model performance was assessed with accuracy and receiver operating characteristic curve analysis. Results: Of 760 cerebral hemorrhage patients enrolled from MIMIC database [mean age, 68.2 years (SD, ±15.5)], 383 (50.4%) patients died in hospital, and 377 (49.6%) patients survived. The area under the receiver operating characteristic curve (AUC) of six machine learning algorithms was 0.600 (nearest neighbors), 0.617 (decision tree), 0.655 (neural net), 0.671(AdaBoost), 0.819 (random forest), and 0.725 (gcForest). The AUC was 0.423 for Acute Physiology and Chronic Health Evaluation II score. The random forest had the highest specificity and accuracy, as well as the greatest AUC, showing the best ability to predict in-hospital mortality. Conclusions: Compared with conventional scoring system and the other five machine learning algorithms in this study, random forest algorithm had better performance in predicting in-hospital mortality for cerebral hemorrhage patients in intensive care units, and thus further research should be conducted on random forest algorithm.

neurosciences,clinical neurology
Study of cardiovascular disease prediction model based on random forest in eastern China

Li Yang,Haibin Wu,Xiaoqing Jin,Pinpin Zheng,Shiyun Hu,Xiaoling Xu,Wei Yu,Jing Yan

DOI: https://doi.org/10.1038/s41598-020-62133-5

IF: 4.6

2020-03-23

Scientific Reports

Abstract:Abstract Cardiovascular disease (CVD) is the leading cause of death worldwide and a major public health concern. CVD prediction is one of the most effective measures for CVD control. In this study, 29930 subjects with high-risk of CVD were selected from 101056 people in 2014, regular follow-up was conducted using electronic health record system. Logistic regression analysis showed that nearly 30 indicators were related to CVD, including male, old age, family income, smoking, drinking, obesity, excessive waist circumference, abnormal cholesterol, abnormal low-density lipoprotein, abnormal fasting blood glucose and else. Several methods were used to build prediction model including multivariate regression model, classification and regression tree (CART), Naïve Bayes, Bagged trees, Ada Boost and Random Forest. We used the multivariate regression model as a benchmark for performance evaluation (Area under the curve, AUC = 0.7143). The results showed that the Random Forest was superior to other methods with an AUC of 0.787 and achieved a significant improvement over the benchmark. We provided a CVD prediction model for 3-year risk assessment of CVD. It was based on a large population with high risk of CVD in eastern China using Random Forest algorithm, which would provide reference for the work of CVD prediction and treatment in China.

multidisciplinary sciences
Development and Validation of a Novel Score for Predicting Long-Term Mortality after an Acute Ischemic Stroke

Ching-Heng Lin,Ya-Wen Kuo,Yen-Chu Huang,Meng Lee,Yi-Wei Huang,Chang-Fu Kuo,Jiann-Der Lee

DOI: https://doi.org/10.3390/ijerph20043043

IF: 4.614

2023-02-09

International Journal of Environmental Research and Public Health

Abstract:Background: Long-term mortality prediction can guide feasible discharge care plans and coordinate appropriate rehabilitation services. We aimed to develop and validate a prediction model to identify patients at risk of mortality after acute ischemic stroke (AIS). Methods: The primary outcome was all-cause mortality, and the secondary outcome was cardiovascular death. This study included 21,463 patients with AIS. Three risk prediction models were developed and evaluated: a penalized Cox model, a random survival forest model, and a DeepSurv model. A simplified risk scoring system, called the C-HAND (history of Cancer before admission, Heart rate, Age, eNIHSS, and Dyslipidemia) score, was created based on regression coefficients in the multivariate Cox model for both study outcomes. Results: All experimental models achieved a concordance index of 0.8, with no significant difference in predicting poststroke long-term mortality. The C-HAND score exhibited reasonable discriminative ability for both study outcomes, with concordance indices of 0.775 and 0.798. Conclusions: Reliable prediction models for long-term poststroke mortality were developed using information routinely available to clinicians during hospitalization.

public, environmental & occupational health,environmental sciences
Weibull Regression and Machine Learning Survival Models: Methodology, Comparison, and Application to Biomedical Data Related to Cardiac Surgery

Thalytta Cavalcante,Raydonal Ospina,Víctor Leiva,Xavier Cabezas,Carlos Martin-Barreiro

DOI: https://doi.org/10.3390/biology12030442

2023-03-14

Biology

Abstract:In this article, we propose a comparative study between two models that can be used by researchers for the analysis of survival data: (i) the Weibull regression model and (ii) the random survival forest (RSF) model. The models are compared considering the error rate, the performance of the model through the Harrell C-index, and the identification of the relevant variables for survival prediction. A statistical analysis of a data set from the Heart Institute of the University of São Paulo, Brazil, has been carried out. In the study, the length of stay of patients undergoing cardiac surgery, within the operating room, was used as the response variable. The obtained results show that the RSF model has less error rate for the training and testing data sets, at 23.55% and 20.31%, respectively, than the Weibull model, which has an error rate of 23.82%. Regarding the Harrell C-index, we obtain the values 0.76, 0.79, and 0.76, for the RSF and Weibull models, respectively. After the selection procedure, the Weibull model contains variables associated with the type of protocol and type of patient being statistically significant at 5%. The RSF model chooses age, type of patient, and type of protocol as relevant variables for prediction. We employ the randomForestSRC package of the R software to perform our data analysis and computational experiments. The proposal that we present has many applications in biology and medicine, which are discussed in the conclusions of this work.

biology
Machine Learning-Based Approaches for Prediction of Patients’ Functional Outcome and Mortality after Spontaneous Intracerebral Hemorrhage

Rui Guo,Renjie Zhang,Ran Liu,Yi Liu,Hao Li,Lu Ma,Min He,Chao You,Rui Tian

DOI: https://doi.org/10.3390/jpm12010112

IF: 3.5083

2022-01-14

Journal of Personalized Medicine

Abstract:Spontaneous intracerebral hemorrhage (SICH) has been common in China with high morbidity and mortality rates. This study aims to develop a machine learning (ML)-based predictive model for the 90-day evaluation after SICH. We retrospectively reviewed 751 patients with SICH diagnosis and analyzed clinical, radiographic, and laboratory data. A modified Rankin scale (mRS) of 0–2 was defined as a favorable functional outcome, while an mRS of 3–6 was defined as an unfavorable functional outcome. We evaluated 90-day functional outcome and mortality to develop six ML-based predictive models and compared their efficacy with a traditional risk stratification scale, the intracerebral hemorrhage (ICH) score. The predictive performance was evaluated by the areas under the receiver operating characteristic curves (AUC). A total of 553 patients (73.6%) reached the functional outcome at the 3rd month, with the 90-day mortality rate of 10.2%. Logistic regression (LR) and logistic regression CV (LRCV) showed the best predictive performance for functional outcome (AUC = 0.890 and 0.887, respectively), and category boosting presented the best predictive performance for the mortality (AUC = 0.841). Therefore, ML might be of potential assistance in the prediction of the prognosis of SICH.

medicine, general & internal,health care sciences & services
A novel machine-learning algorithm for predicting mortality risk after hip fracture surgery

Yi Li,Ming Chen,Houchen Lv,Pengbin Yin,Licheng Zhang,Peifu Tang

DOI: https://doi.org/10.1016/j.injury.2020.12.008

IF: 2.687

2021-06-01

Injury

Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Introduction</h3><p>Although several risk stratification models have been developed to predict hip fracture mortality, efforts are still being placed in this area. Our aim is to (1) construct a risk prediction model for long-term mortality after hip fracture utilizing the RSF method and (2) to evaluate the changing effects over time of individual pre- and post-treatment variables on predicting mortality.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Methods</h3><p>1330 hip fracture surgical patients were included. Forty-five admission and in-hospital variables were analyzed as potential predictors of all-cause mortality. A random survival forest (RSF) algorithm was applied in predictors identification. Cox regression models were then constructed. Sensitivity analyses and internal validation were performed to assess the performance of each model. C statistics were calculated and model calibrations were further assessed.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>Our machine-learning RSF algorithm achieved a c statistic of 0.83 for 30-day prediction and 0.75 for 1-year mortality. Additionally, a COX model was also constructed by using the variables selected by RSF, c statistics were shown as 0.75 and 0.72 when applying in 2-year and 4-year mortality prediction. The presence of post-operative complications remained as the strongest risk factor for both short- and long-term mortality. Variables including fracture location, high serum creatinine, age, hypertension, anemia, ASA, hypoproteinemia, abnormal BUN, and RDW became more important as the length of follow-up increased.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion</h3><p>The RSF machine-learning algorithm represents a novel approach to identify important risk factors and a risk stratification models for patients undergoing hip fracture surgery is built through this approach to identify those at high risk of long-term mortality.</p>
Individual mortality risk predictive system of patients with acute-on-chronic liver failure based on a random survival forest model

Zhi-Qiao Zhang,Gang He,Zhao-Wen Luo,Can-Chang Cheng,Peng Wang,Jing Li,Ming-Gu Zhu,Lang Ming,Ting-Shan He,Yan-Ling Ouyang,Yi-Yan Huang,Xing-Liu Wu,Yi-Nong Ye

DOI: https://doi.org/10.1097/cm9.0000000000001539

IF: 6.133

2021-06-16

Chinese Medical Journal

Abstract:Background: The basis of individualized treatment should be individualized mortality risk predictive information. The present study aimed to develop an online individual mortality risk predictive tool for acute-on-chronic liver failure (ACLF) patients based on a random survival forest (RSF) algorithm.Methods: The current study retrospectively enrolled ACLF patients from the Department of Infectious Diseases of The First People's Hospital of Foshan, Shunde Hospital of Southern Medical University, and Jiangmen Central Hospital. Two hundred seventy-six consecutive ACLF patients were included in the present study as a model cohort (n = 276). Then the current study constructed a validation cohort by drawing patients from the model dataset based on the resampling method (n = 276). The RSF algorithm was used to develop an individual prognostic model for ACLF patients. The Brier score was used to evaluate the diagnostic accuracy of prognostic models. The weighted mean rank estimation method was used to compare the differences between the areas under the time-dependent ROC curves (AUROCs) of prognostic models.Results: Multivariate Cox regression identified hepatic encephalopathy (HE), age, serum sodium level, acute kidney injury (AKI), red cell distribution width (RDW), and international normalization index (INR) as independent risk factors for ACLF patients. A simplified RSF model was developed based on these previous risk factors. The AUROCs for predicting 3-, 6-, and 12-month mortality were 0.916, 0.916, and 0.905 for the RSF model and 0.872, 0.866, and 0.848 for the Cox model in the model cohort, respectively. The Brier scores were 0.119, 0.119, and 0.128 for the RSF model and 0.138, 0.146, and 0.156 for the Cox model, respectively. The nonparametric comparison suggested that the RSF model was superior to the Cox model for predicting the prognosis of ACLF patients.Conclusions: The current study developed a novel online individual mortality risk predictive tool that could predict individual mortality risk predictive curves for individual patients. Additionally, the current online individual mortality risk predictive tool could further provide predicted mortality percentages and 95% confidence intervals at user-defined time points.

medicine, general & internal
Development and validation of a model for the prediction of disease-specific survival in patients with oral squamous cell carcinoma: based on random survival forest analysis

Na Wang,Yulan Lin,Haoyuan Song,Weihai Huang,Jingyao Huang,Liling Shen,Fa Chen,Fengqiong Liu,Jing Wang,Yu Qiu,Bin Shi,Lisong Lin,Baochang He

DOI: https://doi.org/10.1007/s00405-023-08087-6

Abstract:Objective: To establish a model for predicting the disease-specific survival (DSS) of patients with oral squamous cell carcinoma (OSCC). Methods: Patients diagnosed with OSCC from the Surveillance, Epidemiology, and End Results (SEER) database were enrolled and randomly divided into development (n = 14,495) and internal validation cohort (n = 9625). Additionally, a cohort from a hospital located in Southeastern China was utilized for external validation (n = 582). Results: TNM stage, adjuvant treatment, surgery, tumor sites, age, grade, and gender were used for RSF model construction based on the development cohort. The effectiveness of the model was confirmed through time-dependent ROC curves in different cohorts. The risk score exhibited an almost exponential increase in the hazard ratio of death due to OSCC. In development, internal, and external validation cohorts, the prognosis was significantly worse for patients in groups with higher risk scores (all log-rank P < 0.05). Conclusion: Based on RSF, a high-performance prediction model for OSCC prognosis was created and verified in this study.
Similarity-based Random Survival Forest

Yingying Xu,Joon Lee,Joel A. Dubin

DOI: https://doi.org/10.48550/arXiv.1903.01029

2019-08-05

Abstract:Predicting time-to-event outcomes in large databases can be a challenging but important task. One example of this is in predicting the time to a clinical outcome for patients in intensive care units (ICUs), which helps to support critical medical treatment decisions. In this context, the time to an event of interest could be, for example, survival time or time to recovery from a disease/ailment observed within the ICU. The massive health datasets generated from the uptake of Electronic Health Records (EHRs) are quite heterogeneous as patients can be quite dissimilar in their relationship between the feature vector and the outcome, adding more noise than information to prediction. In this paper, we propose a modified random forest method for survival data that identifies similar cases in an attempt to improve accuracy for predicting time-to-event outcomes; this methodology can be applied in various settings, including with ICU databases. We also introduce an adaptation of our methodology in the case of dependent censoring. Our proposed method is demonstrated in the Medical Information Mart for Intensive Care (MIMIC-III) database, and, in addition, we present properties of our methodology through a comprehensive simulation study. Introducing similarity to the random survival forest method indeed provides improved predictive accuracy compared to random survival forest alone across the various analyses we undertook.

Computation,Applications

A comparison of random survival forest and Cox regression for prediction of mortality in patients with hemorrhagic stroke

Comparison of Machine Learning Models and Framingham Risk Score for the prediction of the presence and severity of Coronary Artery Diseases by using Gensini Score

Individual risk prediction: Comparing random forests with Cox proportional‐hazards model by a simulation study

Risk Prediction Model for In-Hospital Mortality in Women with ST-elevation Myocardial Infarction: A Machine Learning Approach

Novel head and neck cancer survival analysis approach: Random survival forests versus cox proportional hazards regression

Random Forest-Based Prediction of Stroke Outcome

Comparison and use of explainable machine learning-based survival models for heart failure patients

Causative Classification of Ischemic Stroke by the Machine Learning Algorithm Random Forests

A New Random Forest Algorithm-Based Prediction Model of Post-operative Mortality in Geriatric Patients With Hip Fractures

The comparisons of random survival forests and Cox regression analysis with simulation and an application related to breast cancer

Prediction of prognosis in elderly patients with sepsis based on machine learning (random survival forest)

Mortality prediction and influencing factors for intensive care unit patients with acute tubular necrosis: random survival forest and cox regression analysis

Mortality Prediction in Cerebral Hemorrhage Patients Using Machine Learning Algorithms in Intensive Care Units

Study of cardiovascular disease prediction model based on random forest in eastern China

Development and Validation of a Novel Score for Predicting Long-Term Mortality after an Acute Ischemic Stroke

Weibull Regression and Machine Learning Survival Models: Methodology, Comparison, and Application to Biomedical Data Related to Cardiac Surgery

Machine Learning-Based Approaches for Prediction of Patients’ Functional Outcome and Mortality after Spontaneous Intracerebral Hemorrhage

A novel machine-learning algorithm for predicting mortality risk after hip fracture surgery

Individual mortality risk predictive system of patients with acute-on-chronic liver failure based on a random survival forest model

Development and validation of a model for the prediction of disease-specific survival in patients with oral squamous cell carcinoma: based on random survival forest analysis

Similarity-based Random Survival Forest