Abstract:Evaluating the treatment effects has become an important topic for many applications. However, most existing literature focuses mainly on the average treatment effects. When the individual effects are heavy-tailed or have outlier values, not only may the average effect not be appropriate for summarizing the treatment effects, but also the conventional inference for it can be sensitive and possibly invalid due to poor large-sample approximations. In this paper we focus on quantiles of individual effects, which can be more robust measures of treatment effects in the presence of extreme individual effects. Moreover, our inference for quantiles of individual effects are purely randomization-based, which avoids any distributional assumption on the units. We first consider inference for stratified randomized experiments, extending the recent work of Caughey et al. (2021). The calculation of valid $p$-values for testing null hypotheses on quantiles of individual effects involves linear integer programming, which is generally NP hard. To overcome this issue, we propose a greedy algorithm with a certain optimal transformation, which has much lower computational cost, still leads to valid $p$-values and is less conservative than the usual relaxation by dropping the integer constraint. We then extend our approach to matched observational studies and propose sensitivity analysis to investigate to what extent our inference on quantiles of individual effects is robust to unmeasured confounding. Both the randomization inference and sensitivity analysis are simultaneously valid for all quantiles of individual effects, which are actually free lunches added to the conventional analysis assuming constant effects. Furthermore, the inference results can be easily visualized and interpreted.

On the Bootstrap Quantile-Treatment-effect Test

Bootstrap Inference for Panel Data Quantile Regression

A Nonparametric Test Of Heterogeneity In Conditional Quantile Treatment Effects

Cluster-Robust Bootstrap Inference in Quantile Regression Models

Quantile‐Based Test for Heterogeneous Treatment Effects

Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

Wild bootstrap inference for penalized quantile regression for longitudinal data

CONDITIONAL MARGINAL TEST FOR HIGH DIMENSIONAL QUANTILE REGRESSION

Treatment Effect Quantiles in Stratified Randomized Experiments and Matched Observational Studies

A bootstrap semiparametric homogeneity test for the distributions of multigroup proportional data, with applications to analysis of quality of life outcomes in clinical trials

Threshold Effect Test in Censored Quantile Regression

Generalized Quantile Treatment Effect: A Flexible Bayesian Approach Using Quantile Ratio Smoothing

Reprint: Hypothesis testing on high dimensional quantile regression

Bootstrap Confidence Interval of Quantile Function Estimation for Small Samples

Estimation and inference for the counterfactual distribution and quantile functions in continuous treatment models

Uniformly Semiparametric Ecient Estimation of Treatment Eects with a Continuous Treatment

Generic Inference on Quantile and Quantile Effect Functions for Discrete Outcomes

Single-index thresholding in quantile regression

Quantile and Probability Curves Without Crossing

Bootstrap Method for Confidence Lower Limit Estimation of Population Percentile and Reliability in Small Number of Test-Sample

On the unbiased asymptotic normality of quantile regression with fixed effects