Abstract:Summary The design of any study, whether experimental or observational, that is intended to estimate the causal effects of a treatment condition relative to a control condition refers to those activities that precede any examination of outcome variables. As defined in our 1983 article (Rosenbaum & Rubin, 1983), the propensity score is the unit-level conditional probability of assignment to treatment versus control given the observed covariates; so the propensity score explicitly does not involve any outcome variables, in contrast to other summaries of variables sometimes used in observational studies. Balancing the distributions of covariates in the treatment and control groups by matching or balancing on the propensity score is therefore an aspect of the design of the observational study. In this invited comment on our 1983 article, we review the situation in the early 1980s and recall some apparent paradoxes that propensity scores helped to resolve. We demonstrate that it is possible to balance an enormous number of low-dimensional summaries of a high-dimensional covariate, even though it is generally impossible to match individuals closely for all the components of a high-dimensional covariate. In a sense, there is only one crucial observed covariate, the propensity score, and there is one crucial unobserved covariate, the principal unobserved covariate. The propensity score and the principal unobserved covariate are equal when treatment assignment is strongly ignorable, that is, unconfounded. Controlling for observed covariates is a prelude to the crucial step from association to causation, the step that addresses potential biases from unmeasured covariates. The design of an observational study also prepares for the step to causation: by selecting comparisons to increase the design sensitivity, by seeking opportunities to detect bias, by seeking mutually supportive evidence affected by different biases, by incorporating quasi-experimental devices such as multiple control groups, and by including the economist’s instruments. All of these considerations reflect the formal development of sensitivity analyses that were largely informal prior to the 1980s.

Should Observational Studies Be Designed to Allow Lack of Balance in Covariate Distributions Across Treatment Groups?

Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation

The Design Versus the Analysis of Observational Studies for Causal Effects: Parallels with the Design of Randomized Trials

On Principles for Modeling Propensity Scores in Medical Research

Detecting critical treatment effect bias in small subgroups

Covariate Balancing Methods for Randomized Controlled Trials Are Not Adversarially Robust

Distinguishing Between Mediators and Confounders is Important for the Causal Inference in Observational Studies

Covariate Balance in Simple, Stratified and Clustered Comparative Studies

Real Effect or Bias? Good Practices for Evaluating the Robustness of Evidence From Comparative Observational Studies Through Quantitative Sensitivity Analysis for Unmeasured Confounding

Propensity scores in the design of observational studies for causal effects

Can the potential benefit of individualizing treatment be assessed using trial summary statistics alone?

ASSIGNMENT TO TREATMENT GROUP ON THE BASIS OF A COVARIATE

Controlling Bias In Observational Studies: A Review

Asymptotic properties of covariate-adaptive randomization

Building Representative Matched Samples With Multi-Valued Treatments in Large Observational Studies

Testing Biased Randomization Assumptions and Quantifying Imperfect Matching and Residual Confounding in Matched Observational Studies

THE ASSESSMENT OF A TREATMENT EFFECT WHEN A COVARIATE IS OBSERVED ON A SUBSET OF THE UNITS: I. SIMPLE ESTIMATORS

Assumptions when Analyzing Randomized Experiments with Noncompliance and Missing Outcomes

Adaptive Combination of Randomized and Observational Data

New multivariate tests for assessing covariate balance in matched observational studies

Assessing Covariate Balance with Small Sample Sizes