Abstract:Matched sampling is a standard technique in the evaluation of treatments in observational studies. Matching on estimated propensity scores comprises an important class of procedures when there are numerous matching variables. Recent theoretical work (Rubin, D. B. and Thomas, N., 1992, The Annals of Statistics 20, 1079-1093) on affinely invariant matching methods with ellipsoidal distributions provides a general framework for evaluating the operating characteristics of such methods. Moreover, Rubin and Thomas (1992, Biometrika 79, 797-809) uses this framework to derive several analytic approximations under normality for the distribution of the first two moments of the matching variables in samples obtained by matching on estimated linear propensity scores. Here we provide a bridge between these theoretical approximations and actual practice. First, we complete and refine the nomal-based analytic approximations, thereby making it possible to apply these results to practice. Second, we perform Monte Carlo evaluations of the analytic results under normal and nonnormal ellipsoidal distributions, which confirm the accuracy of the analytic approximations, and demonstrate the predictable ways in which the approximations deviate from simulation results when normal assumptions are violated within the ellipsoidal family. Third, we apply the analytic approximations to real data with clearly nonellipsoidal distributions, and show that the theoretical expressions, although derived under artificial distributional conditions, produce useful guidance for practice. Our results delineate the wide range of settings in which matching on estimated linear propensity scores performs well, thereby providing useful information for the design of matching studies. When matching with a particular data set, our theoretical approximations provide benchmarks for expected performance under favorable conditions, thereby identifying matching variables requiring special treatment. After matching is complete and data analysis is at hand, our results provide the variances required to compute valid standard errors for common estimators.

The Use of Matched Sampling and Regression Adjustment to Remove Bias in Observational Studies

The use of matched sampling and regression adjustment to remove bias in observational studies

Using multivariate matched sampling and regression adjustment to control bias in observational studies

The use of matched sampling and regression adjustment in observational studies

Controlling Bias In Observational Studies: A Review

Matching to remove bias in observational studies

Testing Biased Randomization Assumptions and Quantifying Imperfect Matching and Residual Confounding in Matched Observational Studies

Combining matching and linear regression: Introducing a mathematical framework and software for simulations, diagnostics and calibration

The covariate-adjusted residual estimator and its use in both randomized trials and observational settings

The bias due to incomplete matching

Characterizing the effect of matching using linear propensity score methods with normal distributions

The Bias Due to Incomplete Matching.

Building Representative Matched Samples With Multi-Valued Treatments in Large Observational Studies

Matching Using Estimated Propensity Scores: Relating Theory to Practice

Multivariate matching methods that are equal percent bias reducing, II: Maximums on bias reduction for fixed sample sizes

MULTIVARIATE MATCHING METHODS THAT ARE EQUAL PERCENT BIAS REDUCING .2. MAXIMUMS ON BIAS REDUCTION FOR FIXED SAMPLE SIZES

Matching and Regression to the Mean in Difference‐in‐Differences Analysis