Abstract:Abstract Background: Propensity score weighting methods are frequently used in observational studies to estimate causal effects. However, researchers usually evaluate their performance only in homogeneous populations. When treatment effects are heterogeneous, it is unclear about the ability of commonly used weighting methods in estimating the average treatment effect (ATE) for the whole population. Methods: Two categories of propensity score weighting approaches are discussed to estimate the ATE for the whole population with heterogeneity: one in which the target of inference is the whole population, including Stabilized inverse probability weighting (SIPW), Empirical likelihood weighting (ELW), Covariate balancing propensity score weighting (CBPS); and the other whose target of inference is the specific population, including Inverse probability weighting with trimming (IPWT), Overlap weighting (OW). To assess the performance of these methods, a simulation study was conducted in terms of bias and root mean square error (RMSE), under six heterogeneity scenarios and three degrees of overlap in the propensity score distributions. Results: According to simulation results, approaches that target the specific population have a substantial bias that rises quickly with increasing heterogeneity. In contrast, approaches for the whole population perform well with relatively smaller bias and RMSE, where CBPS outperforms the others in all heterogeneity scenarios and overlap degrees. When methods are applied to Lindner data with heterogeneity, the results of approaches for the whole population are quite different from approaches for the specific population. Conclusions: When the estimand is the ATE for the whole populations with heterogeneity, applying weighting methods that target specific populations (e.g. IPWT, OW) to estimate it would lead to substantial bias. It is recommended to use methods targeting the whole population (e.g. CBPS, ELW) to achieve this goal.

Marginal mean weighting through stratification: A generalized method for evaluating multivalued and multiple treatments with nonexperimental data.

Propensity score weighting for causal inference with multiple treatments

GBM Propensity Score Weighting for Causal Inference Research

Evaluating propensity score weighting methods in heterogeneous population: a comparative study

Propensity score weighting for causal inference with clustered data

Propensity score weighting for causal inference with multi-stage clustered data

Balance Diagnostics after Propensity Score Matching.

[Introduction to an Individual-Based Standardization Method -- Propensity Score Weighting].

Partially pooled propensity score models for average treatment effect estimation with multilevel data

High-dimensional model-assisted inference for treatment effects with multi-valued treatments

Doubly robust estimation of multivariate fractional outcome means with multivalued treatments

Treatment effect estimation under covariate-adaptive randomization with heavy-tailed outcomes

Propensity Score Weighting with Missing Data on Covariates and Clustered Data Structure

Robust weights that optimally balance confounders for estimating marginal hazard ratios

Doubly weighted M-estimation for nonrandom assignment and missing outcomes

Heterogeneous Treatment Effects in the Presence of Self-Selection: A Propensity Score Perspective

Estimating Heterogeneous Treatment Effects in the Presence of Self-Selection : A Propensity Score Perspective *

Optimal balancing of time-dependent confounders for marginal structural models

Robust Estimation of Causal Effects via High-Dimensional Covariate Balancing Propensity Score

Joint calibrated estimation of inverse probability of treatment and censoring weights for marginal structural models

One-Step weighting to generalize and transport treatment effect estimates to a target population