Abstract:Causal effects are commonly defined as comparisons of the potential outcomes under treatment and control, but this definition is threatened by the possibility that either the treatment or the control condition is not well defined, existing instead in more than one version. This is often a real possibility in nonexperimental or observational studies of treatments because these treatments occur in the natural or social world without the laboratory control needed to ensure identically the same treatment or control condition occurs in every instance. We consider the simplest case: Either the treatment condition or the control condition exists in two versions that are easily recognized in the data but are of uncertain, perhaps doubtful, relevance, for example, branded Advil versus generic ibuprofen. Common practice does not address versions of treatment: Typically, the issue is either ignored or explicitly stated but assumed to be absent. Common practice is reluctant to address two versions of treatment because the obvious solution entails dividing the data into two parts with two analyses, thereby (a) reducing power to detect versions of treatment in each part, (b) creating problems of multiple inference in coordinating the two analyses, and (c) failing to report a single primary analysis that uses everyone. We propose and illustrate a new method of analysis that begins with a single primary analysis of everyone that would be correct if the two versions do not differ, adds a second analysis that would be correct were there two different effects for the two versions, controls the family-wise error rate in all assertions made by the several analyses, and yet pays no price in power to detect a constant treatment effect in the primary analysis of everyone. Our method can be applied to analyses of constant additive treatment effects on continuous outcomes. Unlike conventional simultaneous inferences, the new method is coordinating several analyses that are valid under different assumptions, so that one analysis would never be performed if one knew for certain that the assumptions of the other analysis are true. It is a multiple assumptions problem rather than a multiple hypotheses problem. We discuss the relative merits of the method with respect to more conventional approaches to analyzing multiple comparisons. The method is motivated and illustrated using a study of the possibility that repeated head trauma in high school football causes an increase in risk of early onset cognitive decline.

DEALING WITH MULTIVARIATE OUTCOMES IN STUDIES FOR CAUSAL EFFECTS

Causal Inference Through Potential Outcomes and Principal Stratification: Application to Studies with "Censoring" Due to Death

Principal stratification in causal inference.

Principal Stratification for Causal Inference with Extended Partial Compliance

Causal effects in clinical and epidemiological studies via potential outcomes: concepts and analytical approaches.

For Objective Causal Inference, Design Trumps Analysis

Disentangling Treatment and Placebo Effects in Randomized Experiments Using Principal Stratification-An Introduction

Direct and Indirect Causal Effects via Potential Outcomes*

Causal Inference With Two Versions of Treatment

Robust Estimation of Causal Effects of Binary Treatments in Unconfounded Studies with Dichotomous Outcomes

A Potential Outcomes, and Typically More Powerful, Alternative to 'Cochran-Mantel-Haenszel'

Challenges in interpreting results from ‘multiple regression’ when there is interaction between covariates

Causal Inference Using Potential Outcomes

Principal Stratification with Time-to-Event Outcomes

Relaxed covariate overlap and margin-based causal effect estimation

Principal stratification analysis of noncompliance with time-to-event outcomes

Causal inference for binary non-independent outcomes

Competing risks and multivariate outcomes in epidemiological and clinical trial research

Practical Implications of Modes of Statistical Inference for Causal Effects and the Critical Role of the Assignment Mechanism

Principal stratification with continuous treatments and continuous post-treatment variables

Rejoinder on Causal Inference Through Potential Outcomes and Principal Stratification: Application to Studies with ``Censoring'' Due to Death by D. B. Rubin