Estimating Treatment Effect in the Wild via Differentiated Confounder Balancing

Kun Kuang,Peng Cui,Bo Li,Meng Jiang,Shiqiang Yang

DOI: https://doi.org/10.1145/3097983.3098032

2017-08-04

Abstract:Estimating treatment effect plays an important role on decision making in many fields, such as social marketing, healthcare, and public policy. The key challenge on estimating treatment effect in the wild observational studies is to handle confounding bias induced by imbalance of the confounder distributions between treated and control units. Traditional methods remove confounding bias by re-weighting units with supposedly accurate propensity score estimation under the unconfoundedness assumption. Controlling high-dimensional variables may make the unconfoundedness assumption more plausible, but poses new challenge on accurate propensity score estimation. One strand of recent literature seeks to directly optimize weights to balance confounder distributions, bypassing propensity score estimation. But existing balancing methods fail to do selection and differentiation among the pool of a large number of potential confounders, leading to possible underperformance in many high dimensional settings. In this paper, we propose a data-driven Differentiated Confounder Balancing (DCB) algorithm to jointly select confounders, differentiate weights of confounders and balance confounder distributions for treatment effect estimation in the wild high dimensional settings. The synergistic learning algorithm we proposed is more capable of reducing the confounding bias in many observational studies. To validate the effectiveness of our DCB algorithm, we conduct extensive experiments on both synthetic and real datasets. The experimental results clearly demonstrate that our DCB algorithm outperforms the state-of-the-art methods. We further show that the top features ranked by our algorithm generate accurate prediction of online advertising effect.

What problem does this paper attempt to address?

### Problems the paper attempts to solve

This paper aims to solve the challenges faced in estimating treatment effects in actual observational studies, especially how to deal with confounding bias caused by the unbalanced distribution of confounding variables between the treatment group and the control group. Specifically, the paper focuses on the following two main problems:

1. **Unknown variable interaction model structure**:
- In actual big - data scenarios, the interaction relationships among variables are complex and unknown, and it is very difficult to determine the true model structures of these variables in advance. Therefore, it is impossible to eliminate confounding bias through preset model assumptions.

2. **High - dimensional and noisy variables**:
- In big - data scenarios, a large number of variables are usually observed, but not all of these variables are confounding variables, and different confounding variables contribute differently to the confounding bias in the data. Usually, we do not have enough prior knowledge to judge whether to include hundreds or even thousands of variables. How to distinguish confounding variables and their confounding bias is a great challenge.

### Solutions

To address the above challenges, the authors propose a data - driven method called the **Differentiated Confounding Balance (DCB) algorithm**. The main features of this method are as follows:

- **Joint selection of confounding variables**: Through regularization techniques, truly important confounding variables are selected from a large number of potential confounding variables.
- **Differentiated weighting**: Different weights are assigned to different confounding variables to balance the distribution of confounding variables more accurately.
- **Sample weight optimization**: By optimizing sample weights, the distribution of confounding variables between the treatment group and the control group is balanced.

### Method overview

1. **Problem definition**:
- The treatment effect is defined using the potential outcomes framework, and the goal is to estimate the Average Treatment Effect on the Treated (ATT).
- It is assumed that the unconfoundedness condition is satisfied, that is, given the observed variables, the treatment assignment is independent of the potential outcomes.

2. **Review of traditional methods**:
- Traditional confounding balance methods usually rely on propensity score re - weighting units, but these methods perform poorly in scenarios with high - dimensional variables and complex interaction relationships.

3. **Differentiated confounding balance**:
- An optimization objective function is proposed to optimize the confounding variable weights and sample weights simultaneously to minimize the difference in the distribution of confounding variables between the treatment group and the control group.
- The weight of each confounding variable is learned by regressing the linear model of the potential outcome \( Y(0) \) on the observed variable \( X \).

4. **Optimization algorithm**:
- An iterative method is used to minimize the objective function, and the confounding variable weights and sample weights are updated alternately.
- The optimization problem is solved by the gradient descent and proximal gradient algorithms.

### Experimental verification

The authors conducted extensive experiments using synthetic data and real - world data sets to verify the effectiveness of the DCB algorithm. The experimental results show that the DCB algorithm is superior to existing advanced methods in treatment effect estimation, especially in scenarios with high - dimensional variables and complex interaction relationships.

### Main contributions

- **Addressing new challenges**: A new method for dealing with high - dimensional noisy variables and the lack of prior knowledge of variable interactions in big - data scenarios is proposed.
- **Innovative algorithm**: The DCB algorithm is proposed, which can simultaneously select confounding variables, optimize confounding variable weights and sample weights, thereby estimating treatment effects more accurately.
- **Empirical effect**: Through experiments on synthetic data and real - world data sets, the superior performance of the DCB algorithm in treatment effect estimation is proven.