Abstract:Abstract Background: Propensity score weighting methods are frequently used in observational studies to estimate causal effects. However, researchers usually evaluate their performance only in homogeneous populations. When treatment effects are heterogeneous, it is unclear about the ability of commonly used weighting methods in estimating the average treatment effect (ATE) for the whole population. Methods: Two categories of propensity score weighting approaches are discussed to estimate the ATE for the whole population with heterogeneity: one in which the target of inference is the whole population, including Stabilized inverse probability weighting (SIPW), Empirical likelihood weighting (ELW), Covariate balancing propensity score weighting (CBPS); and the other whose target of inference is the specific population, including Inverse probability weighting with trimming (IPWT), Overlap weighting (OW). To assess the performance of these methods, a simulation study was conducted in terms of bias and root mean square error (RMSE), under six heterogeneity scenarios and three degrees of overlap in the propensity score distributions. Results: According to simulation results, approaches that target the specific population have a substantial bias that rises quickly with increasing heterogeneity. In contrast, approaches for the whole population perform well with relatively smaller bias and RMSE, where CBPS outperforms the others in all heterogeneity scenarios and overlap degrees. When methods are applied to Lindner data with heterogeneity, the results of approaches for the whole population are quite different from approaches for the specific population. Conclusions: When the estimand is the ATE for the whole populations with heterogeneity, applying weighting methods that target specific populations (e.g. IPWT, OW) to estimate it would lead to substantial bias. It is recommended to use methods targeting the whole population (e.g. CBPS, ELW) to achieve this goal.

Comparison of Propensity Score Methods Under Different Confounding Structures:A Simulation Study

Comparing Propensity Score-Based Methods in Estimating the Treatment Effects: A Simulation Study

Propensity score analysis for time-dependent exposure

Propensity Score Method: a Non-Parametric Technique to Reduce Model Dependence

[A Monte-Carlo Study for Propensity Score Methods].

[Application of Propensity Score Matching in the Design of an Epidemiological Study].

Comparison and Application of Matching in Propensity Score Method and Mahalanobis Distance Method

Propensity Score Weighting with Missing Data on Covariates and Clustered Data Structure

Observational studies using propensity score analysis underestimated the effect sizes in critical care medicine.

A simple sensitivity analysis method for unmeasured confounders via linear programming with estimating equation constraints

Propensity Score Matching underestimates Real Treatment Effect, in a simulated theoretical multivariate model

How to perform prespecified subgroup analyses when using propensity score methods in the case of imbalanced subgroups

Balance Diagnostics after Propensity Score Matching.

Theory and practice of propensity score analysis

Propensity Score–based Methods Versus MTE-based Methods in Causal Inference

Evaluating propensity score weighting methods in heterogeneous population: a comparative study

Estimation of Average Treatment Effect Based on a Multi-Index Propensity Score.

Comparison of two propensity score-based methods for balancing covariates: the overlap weighting and fine stratification methods in real-world claims data

Uncertainty of Statistical Models and Propensity Score Methods

Robust Estimating Method for Propensity Score Models and its Application to Some Causal Estimands: A review and proposal

[An Effective Method to Reduce Bias Between Two Compared Groups: Propensity Score].