Abstract:Background: It is often challenging for physicians to decide on the duration of anticoagulation treatment for patients with venous thromboembolism (VTE), as they need to weigh the risk of recurrent thrombosis and bleeding at the same time. Several clinical models have been developed to help physicians identify patients with high risk of bleeding. However, these tools use only the baseline clinical information and are not able to incorporate the clinical conditions and events that occur over time that may influence the risk of bleeding. Therefore, capturing the patterns and relationships in the continuously changing time series of clinical data could be a more powerful approach to developing predictor models than just relying on the baseline clinical information. Nonetheless, creating predictive models from follow-up clinical information is challenging given that time series clinical data are non-uniform, high-dimensional, multivariate observations. Here, we present the first attempt at creating a model that uses the time series follow-up information to predict major bleeding over time using a Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM) cells. Methods: 2542 patients diagnosed with VTE were enrolled in a prospective cohort study over 8 years. In addition to recording their clinical information at baseline, 6-month follow-up interviews were conducted using a standard script to monitor bleeding status and record clinical information. Major bleeding was defined by the International Society on Thrombosis and Haemostasis, with suspected bleeding events classified by an independent adjudication committee. Overall, 118 patients had major bleeding - a 4.6% incidence rate. The median and mode of the clinical variables were used to impute missing numerical and categorical values, respectively, and for patients who had no follow-up information, for whom bleeding occurred before the first follow-up, an artificial follow-up data point was generated from their corresponding baseline data. Thereafter, the data was divided into two stratified sets: 70% for training, and 30% for testing. Five supervised neural network-based machine learning models with different architectures were trained on the baseline dataset, or the follow-up dataset, or both to predict major bleeding. After training, these machine learning models were tested on the testing set and compared to the conventional clinical models, modified to make them compatible with the available predictor variables in our dataset, including the CHAP, the HAS-BLED, the VTE-BLEED, the RIETE, the ACCP, and the OBRI, which only use the baseline information. Results: Overall, the models that used the follow-up information had a higher area under the Receiver Operating Curve (AUROC) or c-statistic compared to the other models that only relied on the baseline dataset. In particular, the LSTM RNN model was able to achieve AUROC of 81.3% that is more than 10% higher compared to the best performing clinical model. We discovered that the LSTM RNN model mostly relied on features such as number of concomitant medications, years since baseline visit, use of specific antibiotics or antiplatelet agents, and presence of new hypertension to predict bleeding from the follow-up dataset. Furthermore, half of the bleeding events occurred within the first year after patients' baseline visits - a trend reflected in the predictions made by LSTM RNN model. Finally, the models that used both the baseline and the follow-up datasets showed different results depending on their architectures; that is, the simpler ensemble model achieved AUROC of 82.5% while the more complex model had AUROC of 70.8% due to overfitting. Conclusion: We have shown that using time series follow-up data can improve bleeding risk prediction in patients with VTE who are on extended anticoagulant therapy compared to just using the baseline data, and clinicians might benefit from using such an approach. Furthermore, our results indicate that LSTM RNN is a suitable architecture to model routine clinical follow-up data. Finally, we believe using time series data could improve the performance of the other clinical models that are currently based on one-time baseline measurements.

Developing a machine learning model for bleeding prediction in patients with cancer-associated thrombosis receiving anticoagulation therapy

Machine Learning for Prediction of Cancer-Associated Venous Thromboembolism

Development and Validation of a Practical Model to Identify Patients at Risk of Bleeding after TAVR

Development and validation of machine learning models to predict the need for haemostatic therapy in acute upper gastrointestinal bleeding

Machine learning derived model for the prediction of bleeding in dual antiplatelet therapy patients

Impact of applying machine learning to the electronic medical record on prediction of cancer-associated thrombosis.

Machine learning analysis of bleeding status in venous thromboembolism patients

Risk Factors Associated with Anticoagulant-Related Bleeding in Patients with Cancer-Associated Thrombosis

Development and Validation of Machine Learning Algorithms to Predict 1-Year Ischemic Stroke and Bleeding Events in Patients with Atrial Fibrillation and Cancer

Machine Learning - Based Bleeding Risk Predictions in Atrial Fibrillation Patients on Direct Oral Anticoagulants

A deep-learning approach to predict bleeding risk over time in patients on extended anticoagulation therapy

Abstract 12307: Machine Learning Model Predicting Bleeding Risk in Patients With Coronary Artery Disease

Using machine learning to predict venous thromboembolism and major bleeding events following total joint arthroplasty

Predicting Major Bleeding in Patients with Venous Thromboembolism on Extended Anticoagulation Therapy Using Follow-up Data and Long Short-Term Memory Based Recurrent Neural Network

Using machine learning to predict the bleeding risk for patients with cardiac valve replacement treated with warfarin in hospitalized

Development and Validation of an ICU-Venous Thromboembolism Prediction Model Using Machine Learning Approaches: A Multicenter Study

A novel dynamic risk score to predict Clinically Significant Bleeding (CSB) after 3 months of anticoagulation in patients with incident Venous ThromboEmbolism (VTE) and without active cancer

Machine learning approach for prediction of outcomes in anticoagulated patients with atrial fibrillation

Machine Learning as a Diagnostic and Prognostic Tool for Predicting Thrombosis in Cancer Patients: A Systematic Review

In Search of the Appropriate Anticoagulant-Associated Bleeding Risk Assessment Model for Cancer-Associated Thrombosis Patients

Harnessing risk assessment for thrombosis and bleeding to optimize anticoagulation strategy in nonvalvular atrial fibrillation