Abstract:Matched sampling is a standard technique in the evaluation of treatments in observational studies. Matching on estimated propensity scores comprises an important class of procedures when there are numerous matching variables. Recent theoretical work (Rubin, D. B. and Thomas, N., 1992, The Annals of Statistics 20, 1079-1093) on affinely invariant matching methods with ellipsoidal distributions provides a general framework for evaluating the operating characteristics of such methods. Moreover, Rubin and Thomas (1992, Biometrika 79, 797-809) uses this framework to derive several analytic approximations under normality for the distribution of the first two moments of the matching variables in samples obtained by matching on estimated linear propensity scores. Here we provide a bridge between these theoretical approximations and actual practice. First, we complete and refine the nomal-based analytic approximations, thereby making it possible to apply these results to practice. Second, we perform Monte Carlo evaluations of the analytic results under normal and nonnormal ellipsoidal distributions, which confirm the accuracy of the analytic approximations, and demonstrate the predictable ways in which the approximations deviate from simulation results when normal assumptions are violated within the ellipsoidal family. Third, we apply the analytic approximations to real data with clearly nonellipsoidal distributions, and show that the theoretical expressions, although derived under artificial distributional conditions, produce useful guidance for practice. Our results delineate the wide range of settings in which matching on estimated linear propensity scores performs well, thereby providing useful information for the design of matching studies. When matching with a particular data set, our theoretical approximations provide benchmarks for expected performance under favorable conditions, thereby identifying matching variables requiring special treatment. After matching is complete and data analysis is at hand, our results provide the variances required to compute valid standard errors for common estimators.

A Note on Identification of Match Fixed Effects as Interpretable Unobserved Match Affinity

Identification and Estimation in Many-to-one Two-sided Matching without Transfers

Identification and Estimation in Many‐to‐One Two‐Sided Matching Without Transfers

Matching Using Estimated Propensity Scores: Relating Theory to Practice

Sensitivity Analysis for Matched Observational Studies with Continuous Exposures and Binary Outcomes

Overidentification in Shift-Share Designs

Building Representative Matched Samples With Multi-Valued Treatments in Large Observational Studies

Demystifying Statistical Matching Algorithms for Big Data

Propensity Score Method: a Non-Parametric Technique to Reduce Model Dependence

Causal Inference in Matching Markets: Cutoff Mechanisms

Individual Rationality Conditions of Identifying Matching Costs in Transferable Utility Matching Games

Cupid's Invisible Hand: Social Surplus and Identification in Matching Models

Assessment of Heterogeneous Treatment Effect Estimation Accuracy via Matching

Differentiated Matching for Individual and Average Treatment Effect Estimation

A deterministic matching method for exact matchings to compare the outcome of different interventions

Estimating Heterogeneous Treatment Effects with Observational Data

Statistical Inference for Covariate-Adjusted and Interpretable Generalized Factor Model with Application to Testing Fairness

Matched Machine Learning: A Generalized Framework for Treatment Effect Inference With Learned Metrics

Generalized Score Matching

Bridging the Gap Between Design and Analysis: Randomization Inference and Sensitivity Analysis for Matched Observational Studies with Treatment Doses

Matching Bounds: How Choice of Matching Algorithm Impacts Treatment Effects Estimates and What to Do about It