[Elective surgery in aneurysms of the abdominal aorta].

G. Coppi,R. Pacchioni,R. Silingardi,E. Vecchiati,C. Catellani,G. Benassi Franciosi

1984-07-01

Abstract:

What problem does this paper attempt to address?

Machine Learning Methods to Estimate Individualized Treatment Effects for Use in Health Technology Assessment

Yingying Zhang,Noemi Kreif,Vijay S Gc,Andrea Manca

DOI: https://doi.org/10.1177/0272989X241263356

2024-07-26

Abstract:Background: Recent developments in causal inference and machine learning (ML) allow for the estimation of individualized treatment effects (ITEs), which reveal whether treatment effectiveness varies according to patients' observed covariates. ITEs can be used to stratify health policy decisions according to individual characteristics and potentially achieve greater population health. Little is known about the appropriateness of available ML methods for use in health technology assessment. Methods: In this scoping review, we evaluate ML methods available for estimating ITEs, aiming to help practitioners assess their suitability in health technology assessment. We present a taxonomy of ML approaches, categorized by key challenges in health technology assessment using observational data, including handling time-varying confounding and time-to event data and quantifying uncertainty. Results: We found a wide range of algorithms for simpler settings with baseline confounding and continuous or binary outcomes. Not many ML algorithms can handle time-varying or unobserved confounding, and at the time of writing, no ML algorithm was capable of estimating ITEs for time-to-event outcomes while accounting for time-varying confounding. Many of the ML algorithms that estimate ITEs in longitudinal settings do not formally quantify uncertainty around the point estimates. Limitations: This scoping review may not cover all relevant ML methods and algorithms as they are continuously evolving. Conclusions: Existing ML methods available for ITE estimation are limited in handling important challenges posed by observational data when used for cost-effectiveness analysis, such as time-to-event outcomes, time-varying and hidden confounding, or the need to estimate sampling uncertainty around the estimates. Implications: ML methods are promising but need further development before they can be used to estimate ITEs for health technology assessments. Highlights: Estimating individualized treatment effects (ITEs) using observational data and machine learning (ML) can support personalized treatment advice and help deliver more customized information on the effectiveness and cost-effectiveness of health technologies.ML methods for ITE estimation are mostly designed for handling confounding at baseline but not time-varying or unobserved confounding. The few models that account for time-varying confounding are designed for continuous or binary outcomes, not time-to-event outcomes.Not all ML methods for estimating ITEs can quantify the uncertainty of their predictions.Future work on developing ML that addresses the concerns summarized in this review is needed before these methods can be widely used in clinical and health technology assessment-like decision making.
Estimating individual treatment effect: generalization bounds and algorithms

Uri Shalit,Fredrik D. Johansson,David Sontag

DOI: https://doi.org/10.48550/arXiv.1606.03976

2017-05-16

Abstract:There is intense interest in applying machine learning to problems of causal inference in fields such as healthcare, economics and education. In particular, individual-level causal inference has important applications such as precision medicine. We give a new theoretical analysis and family of algorithms for predicting individual treatment effect (ITE) from observational data, under the assumption known as strong ignorability. The algorithms learn a "balanced" representation such that the induced treated and control distributions look similar. We give a novel, simple and intuitive generalization-error bound showing that the expected ITE estimation error of a representation is bounded by a sum of the standard generalization-error of that representation and the distance between the treated and control distributions induced by the representation. We use Integral Probability Metrics to measure distances between distributions, deriving explicit bounds for the Wasserstein and Maximum Mean Discrepancy (MMD) distances. Experiments on real and simulated data show the new algorithms match or outperform the state-of-the-art.

Machine Learning,Artificial Intelligence
From Real‐World Patient Data to Individualized Treatment Effects Using Machine Learning: Current and Future Methods to Address Underlying Challenges

Ioana Bica,Ahmed M. Alaa,Craig Lambert,Mihaela Schaar

DOI: https://doi.org/10.1002/cpt.1907

2020-06-28

Abstract:Clinical decision making needs to be supported by evidence that treatments are beneficial to individual patients. Although randomized control trials (RCTs) are the gold standard for testing and introducing new drugs, due to the focus on specific questions with respect to establishing efficacy and safety vs. standard treatment, they do not provide a full characterization of the heterogeneity in the final intended treatment population. Conversely, real-world observational data, such as electronic health records (EHRs), contain large amounts of clinical information about heterogeneous patients and their response to treatments. In this paper, we introduce the main opportunities and challenges in using observational data for training machine learning methods to estimate individualized treatment effects and make treatment recommendations. We describe the modeling choices of the state-of-the-art machine learning methods for causal inference, developed for estimating treatment effects both in the cross-section and longitudinal settings. Additionally, we highlight future research directions that could lead to achieving the full potential of leveraging EHRs and machine learning for making individualized treatment recommendations. We also discuss how experimental data from RCTs and Pharmacometric and Quantitative Systems Pharmacology approaches can be used to not only improve machine learning methods, but also provide ways for validating them. These future research directions will require us to collaborate across the scientific disciplines to incorporate models based on RCTs and known disease processes, physiology, and pharmacology into these machine learning models based on EHRs to fully optimize the opportunity these data present.

pharmacology & pharmacy
A Machine-Learning Approach for Estimating Subgroup- and Individual-Level Treatment Effects: An Illustration Using the 65 Trial

Zia Sadique,Richard Grieve,Karla Diaz-Ordaz,Paul Mouncey,Francois Lamontagne,Stephen O'Neill

DOI: https://doi.org/10.1177/0272989X221100717

Abstract:This article examines a causal machine-learning approach, causal forests (CF), for exploring the heterogeneity of treatment effects, without prespecifying a specific functional form.The CF approach is considered in the reanalysis of the 65 Trial and was found to provide similar estimates of subgroup effects to using a fixed parametric model.The CF approach also provides estimates of individual-level treatment effects that suggest that for most patients in the 65 Trial, the intervention is expected to reduce 90-d mortality but with wide levels of statistical uncertainty.The study illustrates how individual-level treatment effect estimates can be analyzed to generate hypotheses for further research about those patients who are likely to benefit most from an intervention.
Flexible machine learning estimation of conditional average treatment effects: a blessing and a curse

Richard Post,Isabel van den Heuvel,Marko Petkovic,Edwin van den Heuvel

DOI: https://doi.org/10.1097/EDE.0000000000001684

2023-07-20

Abstract:Causal inference from observational data requires untestable identification assumptions. If these assumptions apply, machine learning (ML) methods can be used to study complex forms of causal effect heterogeneity. Recently, several ML methods were developed to estimate the conditional average treatment effect (CATE). If the features at hand cannot explain all heterogeneity, the individual treatment effects (ITEs) can seriously deviate from the CATE. In this work, we demonstrate how the distributions of the ITE and the CATE can differ when a causal random forest (CRF) is applied. We extend the CRF to estimate the difference in conditional variance between treated and controls. If the ITE distribution equals the CATE distribution, this estimated difference in variance should be small. If they differ, an additional causal assumption is necessary to quantify the heterogeneity not captured by the CATE distribution. The conditional variance of the ITE can be identified when the individual effect is independent of the outcome under no treatment given the measured features. Then, in the cases where the ITE and CATE distributions differ, the extended CRF can appropriately estimate the variance of the ITE distribution while the CRF fails to do so.

Methodology,Econometrics,Statistics Theory
Predictive modeling of COPD exacerbation rates using baseline risk factors

Dave Singh,John R Hurst,Fernando J Martinez,Klaus F Rabe,Mona Bafadhel,Martin Jenkins,Domingo Salazar,Paul Dorinsky,Patrick Darken

DOI: https://doi.org/10.1177/17534666221107314

Abstract:Background: Demographic and disease characteristics have been associated with the risk of chronic obstructive pulmonary disease (COPD) exacerbations. Using previously collected multinational clinical trial data, we developed models that use baseline risk factors to predict an individual's rate of moderate/severe exacerbations in the next year on various pharmacological treatments for COPD. Methods: Exacerbation data from 20,054 patients in the ETHOS, KRONOS, TELOS, SOPHOS, and PINNACLE-1, PINNACLE-2, and PINNACLE-4 studies were pooled. Machine learning was used to identify predictors of moderate/severe exacerbation rates. Important factors were selected for generalized linear modeling, further informed by backward variable selection. An independent test set was held back for validation. Results: Prior exacerbations, eosinophil count, forced expiratory volume in 1 s percent predicted, prior maintenance treatments, reliever medication use, sex, COPD Assessment Test score, smoking status, and region were significant predictors of exacerbation risk, with response to inhaled corticosteroids (ICSs) increasing with higher eosinophil counts, more prior exacerbations, or additional prior treatments. Model fit was similar in the training and test set. Prediction metrics were ~10% better in the full model than in a simplified model based only on eosinophil count, prior exacerbations, and ICS use. Conclusion: These models predicting rates of moderate/severe exacerbations can be applied to a broad range of patients with COPD in terms of airway obstruction, eosinophil counts, exacerbation history, symptoms, and treatment history. Understanding the relative and absolute risks related to these factors may be useful for clinicians in evaluating the benefit: risk ratio of various treatment decisions for individual patients.Clinical trials registered with www.clinicaltrials.gov (NCT02465567, NCT02497001, NCT02766608, NCT02727660, NCT01854645, NCT01854658, NCT02343458, NCT03262012, NCT02536508, and NCT01970878).
Causal machine learning for predicting treatment outcomes

Stefan Feuerriegel,Dennis Frauen,Valentyn Melnychuk,Jonas Schweisthal,Konstantin Hess,Alicia Curth,Stefan Bauer,Niki Kilbertus,Isaac S. Kohane,Mihaela van der Schaar

DOI: https://doi.org/10.1038/s41591-024-02902-1

2024-10-11

Abstract:Causal machine learning (ML) offers flexible, data-driven methods for predicting treatment outcomes including efficacy and toxicity, thereby supporting the assessment and safety of drugs. A key benefit of causal ML is that it allows for estimating individualized treatment effects, so that clinical decision-making can be personalized to individual patient profiles. Causal ML can be used in combination with both clinical trial data and real-world data, such as clinical registries and electronic health records, but caution is needed to avoid biased or incorrect predictions. In this Perspective, we discuss the benefits of causal ML (relative to traditional statistical or ML approaches) and outline the key components and steps. Finally, we provide recommendations for the reliable use of causal ML and effective translation into the clinic.

Machine Learning,Applications
Uncovering individualised treatment effects for educational trials

ZhiMin Xiao,Oliver Hauser,Charlie Kirkwood,Daniel Z. Li,Tamsin Ford,Steve Higgins

DOI: https://doi.org/10.1038/s41598-024-73714-z

IF: 4.6

2024-10-02

Scientific Reports

Abstract:Large-scale Randomised Controlled Trials (RCTs) are widely regarded as "the gold standard" for testing the causal effects of school-based interventions. RCTs typically present the statistical significance of the average treatment effect (ATE), which captures the effect an intervention has had on average for a given population . However, key decisions in child health and education are often about individuals who may be very different from those averages. One way to identify heterogeneous treatment effects across different individuals, not captured by the ATE, is to conduct subgroup analyses. For example, free school meal (FSM) pupils as required for projects funded by the Education Endowment Foundation (EEF) in England. These subgroup analyses, as we demonstrate in 48 EEF-funded RCTs involving over 200,000 students, are usually not standardised across studies and offer flexible degrees of freedom to researchers, potentially leading to mixed, if not misleading, results. Here, we develop and deploy an alternative to ATE and subgroup analysis, a machine-learning and regression-based framework to predict individualised treatment effects (ITEs). ITEs could show where an intervention worked, for which individuals, and to what extent. Our findings have implications for decision-makers in fields like education, healthcare, law, and clinical practices concerning children and adolescents.

multidisciplinary sciences
Causal Inference and Counterfactual Prediction in Machine Learning for Actionable Healthcare

Mattia Prosperi,Yi Guo,Matt Sperrin,James S. Koopman,Jae S. Min,Xing He,Shannan Rich,Mo Wang,Iain E. Buchan,Jiang Bian

DOI: https://doi.org/10.1038/s42256-020-0197-y

IF: 23.8

2020-01-01

Nature Machine Intelligence

Abstract:Big data, high-performance computing, and (deep) machine learning are increasingly becoming key to precision medicine—from identifying disease risks and taking preventive measures, to making diagnoses and personalizing treatment for individuals. Precision medicine, however, is not only about predicting risks and outcomes, but also about weighing interventions. Interventional clinical predictive models require the correct specification of cause and effect, and the calculation of so-called counterfactuals, that is, alternative scenarios. In biomedical research, observational studies are commonly affected by confounding and selection bias. Without robust assumptions, often requiring a priori domain knowledge, causal inference is not feasible. Data-driven prediction models are often mistakenly used to draw causal effects, but neither their parameters nor their predictions necessarily have a causal interpretation. Therefore, the premise that data-driven prediction models lead to trustable decisions/interventions for precision medicine is questionable. When pursuing intervention modelling, the bio-health informatics community needs to employ causal approaches and learn causal structures. Here we discuss how target trials (algorithmic emulation of randomized studies), transportability (the licence to transfer causal effects from one population to another) and prediction invariance (where a true causal model is contained in the set of all prediction models whose accuracy does not vary across different settings) are linchpins to developing and testing intervention models.
Stepping Up the Personalized Approach in COPD with Machine Learning

Evgeni Mekov,Marc Miravitlles,Marko Topalovic,Aran Singanayagam,Rosen Petkov

DOI: https://doi.org/10.2174/1573398x19666230607115316

2023-06-07

Current Respiratory Medicine Reviews

Abstract:Introduction: There is increasing interest in the application of artificial intelligence (AI) and machine learning (ML) in all fields of medicine to facilitate greater personalisation of management. Methods: ML could be the next step of personalized medicine in chronic obstructive pulmonary disease (COPD) by giving the exact risk (risk for exacerbation, death, etc.) of every patient (based on his/her parameters like lung function, clinical data, demographics, previous exacerbations, etc.), thus providing a prognosis/risk for the specific patient based on individual characteristics (individual approach). Result: ML algorithm might utilise some traditional risk factors along with some others that may be location-specific (e.g. the risk of exacerbation thatmay be related to ambient pollution but that could vary massively between different countries, or between different regions of a particular country). Conclusion: This is a step forward from the commonly used assignment of patients to a specific group for which prognosis/risk data are available (group approach).
Individual Treatment Effect Prediction for ALS Patients

Heidi Seibold,Achim Zeileis,Torsten Hothorn

DOI: https://doi.org/10.1177/0962280217693034

2016-04-29

Abstract:A treatment for a complicated disease may be helpful for some but not all patients, which makes predicting the treatment effect for new patients important yet challenging. Here we develop a method for predicting the treatment effect based on patient char- acteristics and use it for predicting the effect of the only drug (Riluzole) approved for treating Amyotrophic Lateral Sclerosis (ALS). Our proposed method of model-based ran- dom forests detects similarities in the treatment effect among patients and on this basis computes personalised models for new patients. The entire procedure focuses on a base model, which usually contains the treatment indicator as a single covariate and takes the survival time or a health or treatment success measurement as primary outcome. This base model is used both to grow the model-based trees within the forest, in which the patient characteristics that interact with the treatment are split variables, and to com- pute the personalised models, in which the similarity measurements enter as weights. We applied the personalised models using data from several clinical trials for ALS from the PRO-ACT database. Our results indicate that some ALS patients benefit more from the drug Riluzole than others. Our method allows shifting from stratified medicine to person- alised medicine and can also be used in assessing the treatment effect for other diseases studied in a clinical trial.

Methodology
A Roadmap for Using Causal Inference and Machine Learning to Personalize Asthma Medication Selection

Flory L Nkoy,Bryan L Stone,Yue Zhang,Gang Luo

DOI: https://doi.org/10.2196/56572

2024-04-17

Abstract:Inhaled corticosteroid (ICS) is a mainstay treatment for controlling asthma and preventing exacerbations in patients with persistent asthma. Many types of ICS drugs are used, either alone or in combination with other controller medications. Despite the widespread use of ICSs, asthma control remains suboptimal in many people with asthma. Suboptimal control leads to recurrent exacerbations, causes frequent ER visits and inpatient stays, and is due to multiple factors. One such factor is the inappropriate ICS choice for the patient. While many interventions targeting other factors exist, less attention is given to inappropriate ICS choice. Asthma is a heterogeneous disease with variable underlying inflammations and biomarkers. Up to 50% of people with asthma exhibit some degree of resistance or insensitivity to certain ICSs due to genetic variations in ICS metabolizing enzymes, leading to variable responses to ICSs. Yet, ICS choice, especially in the primary care setting, is often not tailored to the patient's characteristics. Instead, ICS choice is largely by trial and error and often dictated by insurance reimbursement, organizational prescribing policies, or cost, leading to a one-size-fits-all approach with many patients not achieving optimal control. There is a pressing need for a decision support tool that can predict an effective ICS at the point of care and guide providers to select the ICS that will most likely and quickly ease patient symptoms and improve asthma control. To date, no such tool exists. Predicting which patient will respond well to which ICS is the first step toward developing such a tool. However, no study has predicted ICS response, forming a gap. While the biologic heterogeneity of asthma is vast, few, if any, biomarkers and genotypes can be used to systematically profile all patients with asthma and predict ICS response. As endotyping or genotyping all patients is infeasible, readily available electronic health record data collected during clinical care offer a low-cost, reliable, and more holistic way to profile all patients. In this paper, we point out the need for developing a decision support tool to guide ICS selection and the gap in fulfilling the need. Then we outline an approach to close this gap via creating a machine learning model and applying causal inference to predict a patient's ICS response in the next year based on the patient's characteristics. The model uses electronic health record data to characterize all patients and extract patterns that could mirror endotype or genotype. This paper supplies a roadmap for future research, with the eventual goal of shifting asthma care from one-size-fits-all to personalized care, improve outcomes, and save health care resources.
Machine Learning for Real-World Evidence Analysis of COVID-19 Pharmacotherapy

Aurelia Bustos,Patricio Mas_Serrano,Mari L. Boquera,Jose M. Salinas

DOI: https://doi.org/10.48550/arXiv.2107.10239

2021-07-20

Abstract:Introduction: Real-world data generated from clinical practice can be used to analyze the real-world evidence (RWE) of COVID-19 pharmacotherapy and validate the results of randomized clinical trials (RCTs). Machine learning (ML) methods are being used in RWE and are promising tools for precision-medicine. In this study, ML methods are applied to study the efficacy of therapies on COVID-19 hospital admissions in the Valencian Region in Spain. Methods: 5244 and 1312 COVID-19 hospital admissions - dated between January 2020 and January 2021 from 10 health departments, were used respectively for training and validation of separate treatment-effect models (TE-ML) for remdesivir, corticosteroids, tocilizumab, lopinavir-ritonavir, azithromycin and chloroquine/hydroxychloroquine. 2390 admissions from 2 additional health departments were reserved as an independent test to analyze retrospectively the survival benefits of therapies in the population selected by the TE-ML models using cox-proportional hazard models. TE-ML models were adjusted using treatment propensity scores to control for pre-treatment confounding variables associated to outcome and further evaluated for futility. ML architecture was based on boosted decision-trees. Results: In the populations identified by the TE-ML models, only Remdesivir and Tocilizumab were significantly associated with an increase in survival time, with hazard ratios of 0.41 (P = 0.04) and 0.21 (P = 0.001), respectively. No survival benefits from chloroquine derivatives, lopinavir-ritonavir and azithromycin were demonstrated. Tools to explain the predictions of TE-ML models are explored at patient-level as potential tools for personalized decision making and precision medicine. Conclusion: ML methods are suitable tools toward RWE analysis of COVID-19 pharmacotherapies. Results obtained reproduce published results on RWE and validate the results from RCTs.

Machine Learning,Applications
Deep Representation Learning for Individualized Treatment Effect Estimation Using Electronic Health Records.

Peipei Chen,Wei Dong,Xudong Lu,Uzay Kaymak,Kunlun He,Zhengxing Huang

DOI: https://doi.org/10.1016/j.jbi.2019.103303

IF: 8

2019-01-01

Journal of Biomedical Informatics

Abstract:Utilizing clinical observational data to estimate individualized treatment effects (ITE) is a challenging task, as confounding inevitably exists in clinical data. Most of the existing models for ITE estimation tackle this problem by creating unbiased estimators of the treatment effects. Although valuable, learning a balanced representation is sometimes directly opposed to the objective of learning an effective and discriminative model for ITE estimation. We propose a novel hybrid model bridging multi-task deep learning and K-nearest neighbors (KNN) for ITE estimation. In detail, the proposed model firstly adopts multi-task deep learning to extract both outcome-predictive and treatment-specific latent representations from Electronic Health Records (EHR), by jointly performing the outcome prediction and treatment category classification. Thereafter, we estimate counterfactual outcomes by KNN based on the learned hidden representations. We validate the proposed model on a widely used semi-simulated dataset, i.e. IHDP, and a real-world clinical dataset consisting of 736 heart failure (HF) patients. The performance of our model remains robust and reaches 1.7 and 0.23 in terms of Precision in the estimation of heterogeneous effect (PEHE) and average treatment effect (ATE), respectively, on IHDP dataset, and 0.703 and 0.796 in terms of accuracy and F1 score respectively, on HF dataset. The results demonstrate that the proposed model achieves competitive performance over state-of-the-art models. In addition, the results reveal several findings which are consistent with existing medical domain knowledge, and discover certain suggestive hypotheses that could be validated through further investigations in the clinical domain.
Methodological choices and clinical usefulness for machine learning predictions of outcome in Internet-based cognitive behavioural therapy

Nils Hentati Isacsson,Fehmi Ben Abdesslem,Erik Forsell,Magnus Boman,Viktor Kaldo

DOI: https://doi.org/10.1038/s43856-024-00626-4

2024-10-10

Abstract:Background: While psychological treatments are effective, a substantial portion of patients do not benefit enough. Early identification of those may allow for adaptive treatment strategies and improved outcomes. We aimed to evaluate the clinical usefulness of machine-learning (ML) models predicting outcomes in Internet-based Cognitive Behavioural Therapy, to compare ML-related methodological choices, and guide future use of these. Methods: Eighty main models were compared. Baseline variables, weekly symptoms, and treatment activity were used to predict treatment outcomes in a dataset of 6695 patients from regular care. Results: We show that the best models use handpicked predictors and impute missing data. No ML algorithm shows clear superiority. They have a mean balanced accuracy of 78.1% at treatment week four, closely matched by regression (77.8%). Conclusions: ML surpasses the benchmark for clinical usefulness (67%). Advanced and simple models perform equally, indicating a need for more data or smarter methodological designs to confirm advantages of ML.
Estimating individualized treatment effects using an individual participant data meta-analysis

Florie Bouvier,Anna Chaimani,Etienne Peyrot,François Gueyffier,Guillaume Grenet,Raphaël Porcher

DOI: https://doi.org/10.1186/s12874-024-02202-9

2024-03-26

BMC Medical Research Methodology

Abstract:One key aspect of personalized medicine is to identify individuals who benefit from an intervention. Some approaches have been developed to estimate individualized treatment effects (ITE) with a single randomized control trial (RCT) or observational data, but they are often underpowered for the ITE estimation. Using individual participant data meta-analyses (IPD-MA) might solve this problem. Few studies have investigated how to develop risk prediction models with IPD-MA, and it remains unclear how to combine those methods with approaches used for ITE estimation. In this article, we compared different approaches using both simulated and real data with binary and time-to-event outcomes to estimate the individualized treatment effects from an IPD-MA in a one-stage approach.

health care sciences & services
Exacerbation predictive modelling using real-world data from the myCOPD app

Henry M G Glyde,Alison M Blythin,Tom M A Wilkinson,Ian T Nabney,James W Dodd

DOI: https://doi.org/10.1016/j.heliyon.2024.e31201

IF: 3.776

2024-05-14

Heliyon

Abstract:Background: Acute exacerbations of COPD (AECOPD) are episodes of breathlessness, cough and sputum which are associated with the risk of hospitalisation, progressive lung function decline and death. They are often missed or diagnosed late. Accurate timely intervention can improve these poor outcomes. Digital tools can be used to capture symptoms and other clinical data in COPD. This study aims to apply machine learning to the largest available real-world digital dataset to develop AECOPD Prediction tools which could be used to support early intervention and improve clinical outcomes. Objective: To create and validate a machine learning predictive model that forecasts exacerbations of COPD 1-8 days in advance. The model is based on routine patient-entered data from myCOPD self-management app. Method: Adaptations of the AdaBoost algorithm were employed as machine learning approaches. The dataset included 506 patients users between 2017 and 2021. 55,066 app records were available for stable COPD event labels and 1263 records of AECOPD event labels. The data used for training the model included COPD assessment test (CAT) scores, symptom scores, smoking history, and previous exacerbation frequency. All exacerbation records used in the model were confined to the 1-8 days preceding a self-reported exacerbation event. Results: TheEasyEnsemble Classifier resulted in a Sensitivity of 67.0 % and a Specificity of 65 % with a positive predictive value (PPV) of 5.0 % and a negative predictive value (NPV) of 98.9 %. An AdaBoost model with a cost-sensitive decision tree resulted in a a Sensitivity of 35.0 % and a Specificity of 89.0 % with a PPV of 7.08 % and NPV of 98.3 %. Conclusion: This preliminary analysis demonstrates that machine learning approaches to real-world data from a widely deployed digital therapeutic has the potential to predict AECOPD and can be used to confidently exclude the risk of exacerbations of COPD within the next 8 days.
Controlling for Unobserved Confounding with Large Language Model Classification of Patient Smoking Status

Samuel Lee,Zach Wood-Doughty

2024-11-05

Abstract:Causal understanding is a fundamental goal of evidence-based medicine. When randomization is impossible, causal inference methods allow the estimation of treatment effects from retrospective analysis of observational data. However, such analyses rely on a number of assumptions, often including that of no unobserved confounding. In many practical settings, this assumption is violated when important variables are not explicitly measured in the clinical record. Prior work has proposed to address unobserved confounding with machine learning by imputing unobserved variables and then correcting for the classifier's mismeasurement. When such a classifier can be trained and the necessary assumptions are met, this method can recover an unbiased estimate of a causal effect. However, such work has been limited to synthetic data, simple classifiers, and binary variables. This paper extends this methodology by using a large language model trained on clinical notes to predict patients' smoking status, which would otherwise be an unobserved confounder. We then apply a measurement error correction on the categorical predicted smoking status to estimate the causal effect of transthoracic echocardiography on mortality in the MIMIC dataset.

Machine Learning,Artificial Intelligence
A machine learning model for predicting acute exacerbation of in-home chronic obstructive pulmonary disease patients

Huiming Yin,Kun Wang,Ruyu Yang,Yanfang Tan,Qiang Li,Wei Zhu,Suzi Sung

DOI: https://doi.org/10.1016/j.cmpb.2023.108005

IF: 6.1

2024-02-09

Computer Methods and Programs in Biomedicine

Abstract:Purpose This study utilized intelligent devices to remotely monitor patients with chronic obstructive pulmonary disease (COPD), aiming to construct and evaluate machine learning (ML) models that predict the probability of acute exacerbations of COPD (AECOPD). Methods Patients diagnosed with COPD Group C/D at our hospital between March 2019 and June 2021 were enrolled in this study. The diagnosis of COPD Group C/D and AECOPD was based on the GOLD 2018 guidelines. We developed a series of machine learning (ML)-based models, including XGBoost, LightGBM, and CatBoost, to predict AECOPD events. These models utilized data collected from portable spirometers and electronic stethoscopes within a five-day time window. The area under the ROC curve (AUC) was used to assess the effectiveness of the models. Results A total of 66 patients were enrolled in COPD groups C/D, with 32 in group C and 34 in group D. Using observational data within a five-day time window, the ML models effectively predict AECOPD events, achieving high AUC scores. Among these models, the CatBoost model exhibited superior performance, boasting the highest AUC score (0.9721, 95% CI: 0.9623–0.9810). Notably, the boosting tree methods significantly outperformed the time-series based methods, thanks to our feature engineering efforts. A post-hoc analysis of the CatBoost model reveals that features extracted from the electronic stethoscope (e.g., max/min vibration energy) hold more importance than those from the portable spirometer. Conclusions The tree-based boosting models prove to be effective in predicting AECOPD events in our study. Consequently, these models have the potential to enhance remote monitoring, enable early risk assessment, and inform treatment decisions for homebound patients with chronic COPD.

engineering, biomedical,computer science, interdisciplinary applications,medical informatics, theory & methods

[Elective surgery in aneurysms of the abdominal aorta].

Machine Learning Methods to Estimate Individualized Treatment Effects for Use in Health Technology Assessment

Estimating individual treatment effect: generalization bounds and algorithms

From Real‐World Patient Data to Individualized Treatment Effects Using Machine Learning: Current and Future Methods to Address Underlying Challenges

A Machine-Learning Approach for Estimating Subgroup- and Individual-Level Treatment Effects: An Illustration Using the 65 Trial

Flexible machine learning estimation of conditional average treatment effects: a blessing and a curse

Predictive modeling of COPD exacerbation rates using baseline risk factors

Causal machine learning for predicting treatment outcomes

Uncovering individualised treatment effects for educational trials

Causal Inference and Counterfactual Prediction in Machine Learning for Actionable Healthcare

Stepping Up the Personalized Approach in COPD with Machine Learning

Individual Treatment Effect Prediction for ALS Patients

A Roadmap for Using Causal Inference and Machine Learning to Personalize Asthma Medication Selection

Machine Learning for Real-World Evidence Analysis of COVID-19 Pharmacotherapy

Deep Representation Learning for Individualized Treatment Effect Estimation Using Electronic Health Records.

Methodological choices and clinical usefulness for machine learning predictions of outcome in Internet-based cognitive behavioural therapy

Estimating individualized treatment effects using an individual participant data meta-analysis

Exacerbation predictive modelling using real-world data from the myCOPD app

Controlling for Unobserved Confounding with Large Language Model Classification of Patient Smoking Status

A machine learning model for predicting acute exacerbation of in-home chronic obstructive pulmonary disease patients