Abstract:This study examines the problem of determining whether to treat individuals based on observed covariates. The most common decision rule is the conditional empirical success (CES) rule proposed by Manski (2004), which assigns individuals to treatments that yield the best experimental outcomes conditional on the observed covariates. Conversely, using shrinkage estimators, which shrink unbiased but noisy preliminary estimates toward the average of these estimates, is a common approach in statistical estimation problems because it is well-known that shrinkage estimators have smaller mean squared errors than unshrunk estimators. Inspired by this idea, we propose a computationally tractable shrinkage rule that selects the shrinkage factor by minimizing the upper bound of the maximum regret. Then, we compare the maximum regret of the proposed shrinkage rule with that of CES and pooling rules when the parameter space is correctly specified or misspecified. Our theoretical results demonstrate that the shrinkage rule performs well in many cases and these findings are further supported by numerical experiments. Specifically, we show that the maximum regret of the shrinkage rule can be strictly smaller than that of the CES and pooling rules in certain cases when the parameter space is correctly specified. In addition, we find that the shrinkage rule is robust against misspecifications of the parameter space. Finally, we apply our method to experimental data from the National Job Training Partnership Act Study.

What problem does this paper attempt to address?

This paper attempts to solve the problem of determining whether an individual should receive treatment based on observed covariates. Specifically, the research focuses on: 1. **Limitations of existing decision rules**: The most commonly used decision rule is the Conditional Empirical Success (CES) rule, proposed by Manski (2004). The CES rule assigns individuals to the treatment option with the best experimental outcome based on the observed covariates. However, the CES rule only uses the Average Treatment Effect (ATE) estimates under each covariate value and does not fully utilize the information among different individuals. 2. **Introduction of the shrinkage rule**: Inspired by the shrinkage estimators in statistical estimation problems, the author proposes a computationally feasible shrinkage rule. This rule selects the shrinkage factor by minimizing the upper bound of the maximum regret. Shrinkage estimators reduce the mean - squared error by shrinking the unbiased but noisy preliminary estimates towards the mean of these estimates. 3. **Theoretical and empirical analysis**: The author compares the maximum regret of the proposed shrinkage rule with that of the CES rule and the pooling rule when the parameter space is correctly or incorrectly specified. Theoretical results show that the shrinkage rule performs well in many cases, and these findings are supported by numerical experiments. In particular, when the parameter space is correctly specified, the maximum regret of the shrinkage rule can be strictly less than that of the CES and pooling rules. Moreover, the shrinkage rule is robust to the incorrect specification of the parameter space. 4. **Application example**: Finally, the author applies the method to the experimental data of the National Job Training Partnership Act study, further verifying the effectiveness of the method. In conclusion, the main contribution of this paper is to propose a new shrinkage rule, which is not only more computationally efficient but also performs better in dealing with individual heterogeneity and incorrect specification of the parameter space.

Shrinkage Methods for Treatment Choice

Shrinkage for Categorical Regressors

Designing Experiments Toward Shrinkage Estimation

Post‐Estimation Shrinkage in Full and Selected Linear Regression Models in Low‐Dimensional Data Revisited

On the variability of regression shrinkage methods for clinical prediction models: simulation study on predictive performance

Optimizing a Vector of Shrinkage Factors for Continuum Regression

Shrinkage Tuning Parameter Selection with A Diverging Number of Parameters

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Bayes shrinkage estimator for consistency assessment of treatment effects in multi‐regional clinical trials

Estimation of Optimal Dynamic Treatment Assignment Rules under Policy Constraints

Improved Doubly Robust Estimation in Learning Optimal Individualized Treatment Rules

Multivariate Regression Shrinkage and Selection by Canonical Correlation Analysis

Regression-based multiple treatment effect estimation under covariate-adaptive randomization

Identification of the Optimal Treatment Regimen in the Presence of Missing Covariates

Multi-Target Shrinkage

Are causal effect estimations enough for optimal recommendations under multitreatment scenarios?

Evidence Aggregation for Treatment Choice

Optimal subgroup selection

Shrinkage estimation of large covariance matrices using multiple shrinkage targets

Post Selection Shrinkage Estimation for High Dimensional Data Analysis

Decision Theory for Treatment Choice Problems with Partial Identification