Abstract:Abstract Background: Propensity score weighting methods are frequently used in observational studies to estimate causal effects. However, researchers usually evaluate their performance only in homogeneous populations. When treatment effects are heterogeneous, it is unclear about the ability of commonly used weighting methods in estimating the average treatment effect (ATE) for the whole population. Methods: Two categories of propensity score weighting approaches are discussed to estimate the ATE for the whole population with heterogeneity: one in which the target of inference is the whole population, including Stabilized inverse probability weighting (SIPW), Empirical likelihood weighting (ELW), Covariate balancing propensity score weighting (CBPS); and the other whose target of inference is the specific population, including Inverse probability weighting with trimming (IPWT), Overlap weighting (OW). To assess the performance of these methods, a simulation study was conducted in terms of bias and root mean square error (RMSE), under six heterogeneity scenarios and three degrees of overlap in the propensity score distributions. Results: According to simulation results, approaches that target the specific population have a substantial bias that rises quickly with increasing heterogeneity. In contrast, approaches for the whole population perform well with relatively smaller bias and RMSE, where CBPS outperforms the others in all heterogeneity scenarios and overlap degrees. When methods are applied to Lindner data with heterogeneity, the results of approaches for the whole population are quite different from approaches for the specific population. Conclusions: When the estimand is the ATE for the whole populations with heterogeneity, applying weighting methods that target specific populations (e.g. IPWT, OW) to estimate it would lead to substantial bias. It is recommended to use methods targeting the whole population (e.g. CBPS, ELW) to achieve this goal.

Handling Imbalanced Data With Weighted Logistic Regression and Propensity Score Matching methods

Balance Diagnostics after Propensity Score Matching.

An empirical evaluation of imbalanced data strategies from a practitioner's point of view

Linear Probability Models (LPM) and Big Data: The Good, the Bad, and the Ugly

Estimating and Using Propensity Scores with Partially Missing Data

Empirical analysis of performance assessment for imbalanced classification

Propensity Score Weighting with Missing Data on Covariates and Clustered Data Structure

A Comparison of Three Popular Methods for Handling Missing Data: Complete-Case Analysis, Inverse Probability Weighting, and Multiple Imputation

Propensity Score Matching in Accounting Research

Evaluating propensity score weighting methods in heterogeneous population: a comparative study

A Descriptive Study of Variable Discretization and Cost-Sensitive Logistic Regression on Imbalanced Credit Data

Information projection approach to smoothed propensity score weighting for handling selection bias under missing at random

Linear Probability Models (LPM) and Big Data:The Good, The Bad, and The Ugly

A propensity score weighting approach to integrate aggregated data in random-effect individual-level data meta-analysis

Robust propensity score weighting estimation under missing at random

An Extensive Examination of Regression Models with a Binary Outcome Variable.

High-dimensional propensity scores for empirical covariate selection in secondary database studies: Planning, implementation, and reporting

Propensity score matching: a tool for consumer risk modeling and portfolio underwriting

Handling Imbalanced Data: A Case Study for Binary Class Problems

Density-based weighting for imbalanced regression

Adjusted Logistic Propensity Weighting Methods for Population Inference using Nonprobability Volunteer-Based Epidemiologic Cohorts