Abstract:Blinded randomized controlled trials (RCT) require participants to be uncertain if they are receiving a treatment or placebo. Although uncertainty is ideal for isolating the treatment effect from all other potential effects, it is poorly suited for estimating the treatment effect under actual conditions of intended use-when individuals are certain that they are receiving a treatment. We propose an experimental design, randomization to randomization probabilities (R2R), which significantly improves estimates of treatment effects under actual conditions of use by manipulating participant expectations about receiving treatment. In the R2R design, participants are first randomized to a value, π, denoting their probability of receiving treatment (vs. placebo). Subjects are then told their value of π and randomized to either treatment or placebo with probabilities π and 1-π, respectively. Analysis of the treatment effect includes statistical controls for π (necessary for causal inference) and typically a π-by-treatment interaction. Random assignment of subjects to π and disclosure of its value to subjects manipulates subject expectations about receiving the treatment without deception. This method offers a better treatment effect estimate under actual conditions of use than does a conventional RCT. Design properties, guidelines for power analyses, and limitations of the approach are discussed. We illustrate the design by implementing an RCT of caffeine effects on mood and vigilance and show that some of the actual effects of caffeine differ by the expectation that one is receiving the active drug. (PsycINFO Database Record

Why Experimenters Might Not Always Want to Randomize, and What They Could Do Instead

On the Optimality of Randomization in Experimental Design: How to Randomize for Minimax Variance and Design-Based Inference

On Optimal Rerandomization Designs

Randomization does not help much, comparability does

Randomization to Randomization Probability: Estimating Treatment Effects under Actual Conditions of Use.

Rerandomization to Balance Tiers of Covariates

The Optimality of Blocking Designs in Equally and Unequally Allocated Randomized Experiments with General Response

Nearly Random Designs with Greatly Improved Balance

Power and Sample Size Calculations for Rerandomization

Efficient Balanced Treatment Assignments for Experimentation

Optimal allocation of sample size for randomization-based inference from 2 K factorial designs

Some theoretical foundations for the design and analysis of randomized experiments

Optimal Stratification of Survey Experiments

Optimal Adaptive Experimental Design for Estimating Treatment Effect

Dealing with Possible Baseline Inequalities Between Experimental Groups - The Case of Motor Learning

Design-based theory for cluster rerandomization

Designing Experiments Toward Shrinkage Estimation

Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies

Randomized experiments to detect and estimate social influence in networks

Rerandomization in Stratified Randomized Experiments

Experimenting on Markov Decision Processes with Local Treatments