Abstract:Purpose: Observational research provides valuable insights into treatments used in patient populations in real-world settings. However, confounding is likely to occur if there are differences in patient characteristics associated with both the exposure and outcome between the groups being evaluated. One approach to reduce confounding and facilitate unbiased comparisons is inverse probability of treatment weighting (IPTW) using propensity scores. Machine learning (ML) and entropy balancing can potentially be used in generating propensity scores for IPTW, but there is limited literature on this application. We aimed to assess the feasibility of applying these methods for reducing confounding in observational studies. These methods were assessed in a study comparing cardiovascular outcomes in adults with type 2 diabetes and established atherosclerotic cardiovascular disease taking once-weekly glucagon-like peptide-1 receptor agonists or dipeptidyl peptidase-4 inhibitors. Methods: We applied advanced methods to generate the propensity scores compared to the original logistic regression method in terms of covariate balance. After calculating weights, a weighted Cox proportional hazards model was used to calculate the sample average treatment effect. Support Vector Classification, Support Vector Regression, XGBoost, and LightGBM were the ML models used. Entropy balancing was also performed on features identified in the original cardiovascular outcomes study. Results: Accuracy (range: 0.71 to 0.73), area under the curve (0.77 to 0.79), precision (0.53 to 0.60), recall (0.66 to 0.68), and F1 score (0.60 to 0.64) were similar between all of the advanced propensity score methods and traditional logistic regression. Among ML models, only XGBoost achieved balance in all measured baseline characteristics between the two treatment groups, closely approximating the performance of the original logistic regression. Entropy balancing weights provided the best performance among all models in balancing baseline characteristics, achieving near perfect balancing. Conclusion: Among the advanced methods examined, entropy balancing weights performed the best for optimizing balancing and can produce similar results compared to traditional logistic regression.

Comparison of two propensity score-based methods for balancing covariates: the overlap weighting and fine stratification methods in real-world claims data

Optimization‐Based Stable Balancing Weights Versus Propensity Score Weighting for Samples With High Covariate Imbalance

Addressing Extreme Propensity Scores via the Overlap Weights

Propensity score weighting for causal inference with multiple treatments

Balancing versus modelling in weighted analysis of non‐randomised studies with survival outcomes: A simulation study

Using Balancing Weights to Target the Treatment Effect on the Treated when Overlap is Poor

Evaluating propensity score weighting methods in heterogeneous population: a comparative study

Subgroup Balancing Propensity Score

Balance Diagnostics after Propensity Score Matching.

Propensity Score Methods for Creating Covariate Balance in Observational Studies

Measuring covariate balance in weighted propensity score analyses by the weighted z-difference

Causal inference in the absence of positivity: The role of overlap weights

Using entropy balancing to strengthen an observational cohort study design: lessons learned from an evaluation of a complex multi-state federal demonstration

Comparison of Propensity Score Methods Under Different Confounding Structures:A Simulation Study

Propensity Score Weighting for Causal Subgroup Analysis

Comparing Machine Learning and Advanced Methods with Traditional Methods to Generate Weights in Inverse Probability of Treatment Weighting: The INFORM Study

Energy balancing of covariate distributions

Comparing Propensity Score-Based Methods in Estimating the Treatment Effects: A Simulation Study

Propensity Score Analysis with Guaranteed Subgroup Balance

Robust weights that optimally balance confounders for estimating marginal hazard ratios

High Dimensional Propensity Score Estimation via Covariate Balancing