Abstract:Causal effects are commonly defined as comparisons of the potential outcomes under treatment and control, but this definition is threatened by the possibility that either the treatment or the control condition is not well defined, existing instead in more than one version. This is often a real possibility in nonexperimental or observational studies of treatments because these treatments occur in the natural or social world without the laboratory control needed to ensure identically the same treatment or control condition occurs in every instance. We consider the simplest case: Either the treatment condition or the control condition exists in two versions that are easily recognized in the data but are of uncertain, perhaps doubtful, relevance, for example, branded Advil versus generic ibuprofen. Common practice does not address versions of treatment: Typically, the issue is either ignored or explicitly stated but assumed to be absent. Common practice is reluctant to address two versions of treatment because the obvious solution entails dividing the data into two parts with two analyses, thereby (a) reducing power to detect versions of treatment in each part, (b) creating problems of multiple inference in coordinating the two analyses, and (c) failing to report a single primary analysis that uses everyone. We propose and illustrate a new method of analysis that begins with a single primary analysis of everyone that would be correct if the two versions do not differ, adds a second analysis that would be correct were there two different effects for the two versions, controls the family-wise error rate in all assertions made by the several analyses, and yet pays no price in power to detect a constant treatment effect in the primary analysis of everyone. Our method can be applied to analyses of constant additive treatment effects on continuous outcomes. Unlike conventional simultaneous inferences, the new method is coordinating several analyses that are valid under different assumptions, so that one analysis would never be performed if one knew for certain that the assumptions of the other analysis are true. It is a multiple assumptions problem rather than a multiple hypotheses problem. We discuss the relative merits of the method with respect to more conventional approaches to analyzing multiple comparisons. The method is motivated and illustrated using a study of the possibility that repeated head trauma in high school football causes an increase in risk of early onset cognitive decline.

Causal Inference From 2(K) Factorial Designs By Using Potential Outcomes

Causal Inference from 2^k Factorial Designs Using the Potential Outcomes Model

Causal Inference Using Potential Outcomes

On Randomization-based and Regression-based Inferences for 2^K Factorial Designs

Sharpening randomization-based causal inference for $2^2$ factorial designs with binary outcomes

Optimal allocation of sample size for randomization-based inference from 2 K factorial designs

Using Standard Tools from Finite Population Sampling to Improve Causal Inference for Complex Experiments

On randomization-based causal inference for matched-pair factorial designs

Causal Inference in Rebuilding and Extending the Recondite Bridge Between Finite Population Sampling and Experimental Design

Sampling-based randomized designs for causal inference under the potential outcomes framework

Causal effects in clinical and epidemiological studies via potential outcomes: concepts and analytical approaches.

Regression-based causal inference with factorial experiments: estimands, model specifications, and design-based properties

Causal inference from treatment-control studies having an additional factor with unknown assignment mechanism

Causal Inference from Possibly Unbalanced Split-Plot Designs: A Randomization-based Perspective

Improving Covariate Balance in 2^K Factorial Designs via Rerandomization

A Bayesian Perspective on the Analysis of Unreplicated Factorial Experiments Using Potential Outcomes.

Synthetic Combinations: A Causal Inference Framework for Combinatorial Interventions

Causal Inference With Two Versions of Treatment

Causal Inference: A Missing Data Perspective

Causal Inference Through Potential Outcomes and Principal Stratification: Application to Studies with "Censoring" Due to Death

Potential weights and implicit causal designs in linear regression