Abstract:Matched sampling is a standard technique in the evaluation of treatments in observational studies. Matching on estimated propensity scores comprises an important class of procedures when there are numerous matching variables. Recent theoretical work (Rubin, D. B. and Thomas, N., 1992, The Annals of Statistics 20, 1079-1093) on affinely invariant matching methods with ellipsoidal distributions provides a general framework for evaluating the operating characteristics of such methods. Moreover, Rubin and Thomas (1992, Biometrika 79, 797-809) uses this framework to derive several analytic approximations under normality for the distribution of the first two moments of the matching variables in samples obtained by matching on estimated linear propensity scores. Here we provide a bridge between these theoretical approximations and actual practice. First, we complete and refine the nomal-based analytic approximations, thereby making it possible to apply these results to practice. Second, we perform Monte Carlo evaluations of the analytic results under normal and nonnormal ellipsoidal distributions, which confirm the accuracy of the analytic approximations, and demonstrate the predictable ways in which the approximations deviate from simulation results when normal assumptions are violated within the ellipsoidal family. Third, we apply the analytic approximations to real data with clearly nonellipsoidal distributions, and show that the theoretical expressions, although derived under artificial distributional conditions, produce useful guidance for practice. Our results delineate the wide range of settings in which matching on estimated linear propensity scores performs well, thereby providing useful information for the design of matching studies. When matching with a particular data set, our theoretical approximations provide benchmarks for expected performance under favorable conditions, thereby identifying matching variables requiring special treatment. After matching is complete and data analysis is at hand, our results provide the variances required to compute valid standard errors for common estimators.

Large Sample Properties of Matching for Balance

Building Representative Matched Samples With Multi-Valued Treatments in Large Observational Studies

Matching Bounds: How Choice of Matching Algorithm Impacts Treatment Effects Estimates and What to Do about It

Balance Diagnostics after Propensity Score Matching.

Matching to Remove Bias in Observational Studies

Variable-Ratio Matching with Fine Balance in a Study of Peer Health Exchange

Using Cardinality Matching to Design Balanced and Representative Samples for Observational Studies

On the consistency of bootstrap for matching estimators

Assessing Covariate Balance with Small Sample Sizes

On the limiting variance of matching estimators

Better Experimental Design by Hybridizing Binary Matching with Imbalance Optimization

Asymptotics of Caliper Matching Estimators for Average Treatment Effects

Propensity Score Method: a Non-Parametric Technique to Reduce Model Dependence

Matching Using Estimated Propensity Scores: Relating Theory to Practice

Affinely Invariant Matching Methods with Ellipsoidal Distributions

The Bias Due to Incomplete Matching.

Inference in Experiments with Matched Pairs and Imperfect Compliance

Investigating an Alternative for Estimation from a Nonprobability Sample: Matching plus Calibration

Demystifying Statistical Matching Algorithms for Big Data

Matching in Selective and Balanced Representation Space for Treatment Effects Estimation

MULTIVARIATE MATCHING METHODS THAT ARE EQUAL PERCENT BIAS REDUCING, II: MAXIMUMS ON BIAS REDUCTION FOR FIXED SAMPLE SIZES