Abstract:A discussion of matching, randomization, random sampling, and other methods of controlling extraneous variation is presented. The objective is to specify the benefits of randomization in estimating causal effects of treatments. The basic conclusion is that randomization should be employed whenever possible but that the use of carefully controlled nonrandomized data to estimate causal effects is a reasonable and necessary procedure in many cases. Recent psychological and educational literature has included extensive criticism of the use of nonrandomized studies to estimate causal effects of treatments (e.g., Campbell & Erlebacher, 1970). The implication in much of this literature is that only properly randomized experiments can lead to useful estimates of causal effects. If taken as applying to all fields of study, this position is untenable. Since the extensive use of randomized experiments is limited to the last half century,8 and in fact is not used in much scientific investigation today,4 one is led to the conclusion that most scientific truths have been established without using randomized experiments. In addition, most of us successfully determine the causal effects of many of our everyday actions, even interpersonal behaviors, without the benefit of randomization. Even if the position that causal effects of treatments can only be well established from randomized experiments is taken as applying only to the social sciences in which

Formal mode of statistical inference for causal effects

Practical Implications of Modes of Statistical Inference for Causal Effects and the Critical Role of the Assignment Mechanism

Bayesian Inference for Causal Effects

Statistical Inference For Causal Effects, With Emphasis On Applications In Epidemiology And Medical Statistics

Bayesian Inference for Causal Effects: the Role of Randomization

For Objective Causal Inference, Design Trumps Analysis

Causal Inference for Statistics, Social, and Biomedical Sciences: an Introduction

Estimating causal effects of treatments in experimental and observational studies

Causal effects in clinical and epidemiological studies via potential outcomes: concepts and analytical approaches.

Causal Inference Using Potential Outcomes

24 Statistical Inference for Causal Effects, with Emphasis on Applications in Psychometrics and Education

Statistics and Causal Inference

Causal Inference in the Social Sciences

DEALING WITH MULTIVARIATE OUTCOMES IN STUDIES FOR CAUSAL EFFECTS

Causal Inference in Rebuilding and Extending the Recondite Bridge Between Finite Population Sampling and Experimental Design

Causal inference under over-simplified longitudinal causal models

Causal inference for ordinal outcomes

Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies

Causal Inference Through Potential Outcomes and Principal Stratification: Application to Studies with "Censoring" Due to Death

Causal Inference: A Missing Data Perspective

Using Standard Tools from Finite Population Sampling to Improve Causal Inference for Complex Experiments