Uplift Modeling based on Graph Neural Network Combined with Causal Knowledge

Haowen Wang,Xinyan Ye,Yangze Zhou,Zhiyi Zhang,Longhan Zhang,Jing Jiang
2023-11-14
Abstract:Uplift modeling is a fundamental component of marketing effect modeling, which is commonly employed to evaluate the effects of treatments on outcomes. Through uplift modeling, we can identify the treatment with the greatest benefit. On the other side, we can identify clients who are likely to make favorable decisions in response to a certain treatment. In the past, uplift modeling approaches relied heavily on the difference-in-difference (DID) architecture, paired with a machine learning model as the estimation learner, while neglecting the link and confidential information between features. We proposed a framework based on graph neural networks that combine causal knowledge with an estimate of uplift value. Firstly, we presented a causal representation technique based on CATE (conditional average treatment effect) estimation and adjacency matrix structure learning. Secondly, we suggested a more scalable uplift modeling framework based on graph convolution networks for combining causal knowledge. Our findings demonstrate that this method works effectively for predicting uplift values, with small errors in typical simulated data, and its effectiveness has been verified in actual industry marketing data.
Machine Learning,Artificial Intelligence
What problem does this paper attempt to address?
The paper primarily focuses on addressing the uplift modeling problem in marketing effect modeling, particularly on how to more accurately assess the impact of interventions on outcomes. Traditional uplift modeling methods rely on the Difference-in-Differences (DID) framework, combined with machine learning models as estimation learners, but they overlook the connections and potential information between features. To improve this, the authors propose a new framework based on Graph Neural Networks (GNN) and incorporate causal knowledge to estimate uplift values. Specifically, the main contributions of the paper include: 1. **Causal Representation Technique**: A causal representation technique based on Conditional Average Treatment Effect (CATE) estimation and adjacency matrix structure learning is proposed. This allows for the identification of which features are most critical for predicting intervention effects. 2. **Scalable Uplift Modeling Framework**: A scalable uplift modeling framework based on Graph Convolutional Networks is proposed to integrate causal knowledge. This method can more effectively utilize the relationships between features and shows smaller prediction errors in simulated data. 3. **Application of Graph Neural Networks**: By constructing features as nodes and using Graph Convolutional Networks to learn the associations between these nodes, a more accurate estimation of uplift values is achieved. The experimental section demonstrates the effectiveness of the proposed framework on typical simulated datasets as well as actual industrial marketing datasets. Compared to traditional methods, this framework can more accurately predict uplift values and performs more stably in more complex scenarios. In summary, the goal of this paper is to improve the effectiveness of uplift modeling by introducing Graph Neural Networks and causal knowledge, aiming to better identify which customers are most likely to respond positively to a certain intervention.