Abstract:OBJECTIVE:Estimating the individualized treatment effect (ITE) from observational data is a challenging task due to selection bias, which results from the distributional discrepancy between different treatment groups caused by the dependence between features and assigned treatments. This dependence is induced by the factors related to the treatment assignment. We hypothesize that features consist of three types of latent factors: outcome-specific factors, treatment-specific factors and confounders. Then, we aim to reduce the influence of treatment-related factors, i.e., treatment-specific factors and confounders, on outcome prediction to mitigate the effects of selection bias.METHOD:We present a novel representation learning model in which both the main task of outcome prediction and the auxiliary task of classifying the treatment assignment are used to learn the outcome-oriented and treatment-oriented latent representations, respectively. However, since the confounders are related to both treatment assignment and outcome, it is still contained in the representations. To further reduce influence of the confounders contained in both representations, individualized orthogonal regularization is incorporated into the proposed model. The orthogonal regularization forces the outcome-oriented and treatment-oriented latent representations of an individual to be vertical in the inner product space, meaning they are orthogonal with each other, and the common information of confounder is reduced. Such that the ITE can be estimated more precisely without the effects of selection bias.RESULT:We evaluate our proposed model on a semi-simulated dataset and a real-world dataset. The experimental results demonstrate that the proposed model achieves competitive or better performance compared with the performances of the state-of-the-art models.CONCLUSION:The proposed method is well performed on ITE estimation with the ability to reduce selection bias thoroughly by incorporating an auxiliary task and adopting orthogonal regularization to disentangle the latent factors.SIGNIFICANCE:This paper offers a novel method of reducing selection bias in estimating the ITE from observational data by disentangled representation learning.

Orthogonal Policy Learning Under Ambiguity

Decision Theory for Treatment Choice Problems with Partial Identification

Identification of Subgroups With Similar Benefits in Off-Policy Policy Evaluation

Matching-Based Policy Learning

Efficient augmentation and relaxation learning for individualized treatment rules using observational data

Estimating individual treatment effect: generalization bounds and algorithms

An optimal learning method for developing personalized treatment regimes

More Efficient Policy Learning via Optimal Retargeting

Policy Learning with New Treatments

Policy Learning with Competing Agents

Positivity-free Policy Learning with Observational Data

Estimation of Optimal Dynamic Treatment Assignment Rules under Policy Constraints

Robust Fitted-Q-Evaluation and Iteration under Sequentially Exogenous Unobserved Confounders

Improved Doubly Robust Estimation in Learning Optimal Individualized Treatment Rules

Inverse Online Learning: Understanding Non-Stationary and Reactionary Policies

Generalizing Off-Policy Learning under Sample Selection Bias

On Learning Disentangled Representations for Individual Treatment Effect Estimation.

Identification and Estimation of Heterogeneous Treatment Effects under Non-compliance or Non-ignorable assignment

Policy Relevant Treatment Effects with Multidimensional Unobserved Heterogeneity

Targeted Learning Ensembles for Optimal Individualized Treatment Rules with Time-to-Event Outcomes

Optimal and Fair Encouragement Policy Evaluation and Learning