Abstract:Identification of heterogeneous treatment effects (HTEs) has been increasingly popular and critical in various penalized strategy decisions using the A/B testing approach, especially in the scenario of a consecutive online collection of samples. However, in high-dimensional settings, such an identification remains challenging in the sense of lack of detection power of HTEs with insufficient sample instances for each batch sequentially collected online. In this article, a novel high-dimensional test is proposed, named as the penalized online sequential test (POST), to identify HTEs and select useful covariates simultaneously under continuous monitoring in generalized linear models (GLMs), which achieves high detection power and controls the Type I error. A penalized score test statistic is developed along with an extended p-value process for the online collection of samples, and the proposed POST method is further extended to multiple online testing scenarios, where both high true positive rates and under-controlled false discovery rates are achieved simultaneously. Asymptotic results are established and justified to guarantee properties of the POST, and its performance is evaluated through simulations and analysis of real data, compared with the state-of-the-art online test methods. Our findings indicate that the POST method exhibits selection consistency and superb detection power of HTEs as well as excellent control over the Type I error, which endows our method with the capability for timely and efficient inference for online A/B testing in high-dimensional GLMs framework.

A Penalized Online Sequential Test of Heterogeneous Treatment Effects for Generalized Linear Models

A New Framework for Online Testing of Heterogeneous Treatment Effect

False Discovery Rate Controlled Heterogeneous Treatment Effect Detection for Online Controlled Experiments

Jewish Religious Ethics Mandate Access to Antiretroviral Drugs in Developing Countries

An Online Sequential Test for Qualitative Treatment Effects

TESTING FOR UNOBSERVED HETEROGENEOUS TREATMENT EFFECTS WITH OBSERVATIONAL DATA

ASSESSING THE TREATMENT EFFECT HETEROGENEITY WITH A LATENT VARIABLE

An Adaptive Test on High-dimensional Parameters in Generalized Linear Models

Augmented Learning of Heterogeneous Treatment Effects via Gradient Boosting Trees

A Systematic Paradigm for Detecting, Surfacing, and Characterizing Heterogeneous Treatment Effects (HTE)

A Sparse Random Projection-Based Test for Overall Qualitative Treatment Effects

Estimating Heterogeneous Treatment Effects: Mutual Information Bounds and Learning Algorithms.

A Nonparametric Test of Heterogeneous Treatment Effects under Interference

A Sequential Significance Test for Treatment by Covariate Interactions

Using a Surrogate with Heterogeneous Utility to Test for a Treatment Effect

A Permutation Test for Assessing the Presence of Individual Differences in Treatment Effects

Assessment of Heterogeneous Treatment Effect Estimation Accuracy via Matching

Heterocedasticity-Adjusted Ranking and Thresholding for Large-Scale Multiple Testing

Testing for Treatment Effect in Covariate-Adaptive Randomized Clinical Trials with Generalized Linear Models and Omitted Covariates

Optimal Statistical Inference for Individualized Treatment Effects in High-dimensional Models

Efficient Targeted Learning of Heterogeneous Treatment Effects for Multiple Subgroups