Abstract:As a key component in boosting online user growth, uplift modeling aims to measure individual user responses (e.g., whether to play the game) to various treatments, such as gaming bonuses, thereby enhancing business outcomes. However, previous research typically considers a single-task, single-treatment setting, where only one treatment exists and the overall treatment effect is measured by a single type of user response. In this paper, we propose a Multi-Treatment Multi-Task (MTMT) uplift network to estimate treatment effects in a multi-task scenario. We identify the multi-treatment problem as a causal inference problem with a tiered response, comprising a base effect (from offering a treatment) and an incremental effect (from offering a specific type of treatment), where the base effect can be numerically much larger than the incremental effect. Specifically, MTMT separately encodes user features and treatments. The user feature encoder uses a multi-gate mixture of experts (MMOE) network to encode relevant user features, explicitly learning inter-task relations. The resultant embeddings are used to measure natural responses per task. Furthermore, we introduce a treatment-user feature interaction module to model correlations between each treatment and user feature. Consequently, we separately measure the base and incremental treatment effect for each task based on the produced treatment-aware representations. Experimental results based on an offline public dataset and an online proprietary dataset demonstrate the effectiveness of MTMT in single/multi-treatment and single/multi-task settings. Additionally, MTMT has been deployed in our gaming platform to improve user experience.

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve This paper aims to address how to accurately measure individual user responses to various treatments (such as game bonuses) for different tasks (such as whether to play a game) to enhance business outcomes in boosting online user growth. However, previous research typically focuses on single-task, single-treatment settings, where only one type of treatment exists, and the overall treatment effect is measured by a single type of user response. This leads to an inability to comprehensively capture the complex interactions between treatments and responses in practical applications, thereby affecting the accurate estimation of treatment effects. ### Specific Problem Description 1. **Multi-Treatment Multi-Task Problem**: In real-world scenarios, multiple treatments often jointly influence the target response, and multiple responses collectively contribute to the overall result. However, most existing models focus only on a single treatment and a single target response, ignoring the complex interactions between treatments and responses, leading to incomplete representation and biased treatment effect estimation. 2. **Interaction Between Treatment and User Characteristics**: Existing models usually focus on utilizing user and contextual features while ignoring treatment features. The correlation between treatment and user characteristics is crucial for enhancing modeling, especially in multi-treatment settings. For example, low-active users are more likely to continue playing games when receiving high-value bonuses, while high-active users may continue playing games regardless of receiving bonuses. Although some work has incorporated treatment features as inputs to improve estimation accuracy, they have failed to fully model the interaction between treatment and user characteristics in a task-oriented manner. ### Solution To address the above issues, the authors propose a Multi-Treatment Multi-Task (MTMT) uplift modeling framework that directly models the interaction between users and treatments. Specifically: - **Multi-Treatment Hierarchical Problem**: Recognize multiple treatments as a hierarchical treatment problem, where the base treatment defines whether the user receives a treatment, and the secondary treatment defines the specific type and amount of treatment. For example, first decide whether to give the user a game bonus (called treatment decision), and then decide which type of bonus to give (called treatment choice). - **Separately Estimate Base Uplift and Incremental Uplift**: Separately estimate the base uplift of the treatment group and the incremental uplift of specific treatments. MTMT encodes user features through a representation network based on Multi-gate Mixture-of-Experts (MMOE), generating embeddings used to calculate the natural response for each task. Meanwhile, the treatment encoder independently encodes the base treatment and its subsequent secondary treatment information. - **User-Treatment Interaction Module**: Explicitly model how treatments attend to each user feature. The combined information is further enhanced and projected to calculate the response of different treatment groups. This approach ensures a more accurate and detailed estimation of treatment effects, addressing the complexity of multi-treatment and multi-task scenarios. ### Contributions - **Background**: Aims to accurately model the uplift of multiple potential treatments and multiple target responses. To our knowledge, this is the first effort to conduct multi-treatment multi-task uplift modeling without basic assumptions about treatments or tasks. - **Method**: Introduces a novel uplift model that explicitly captures user-treatment feature interactions through a self-attention mechanism. By separately estimating the base uplift and the uplift differences between treatments, the model considers minimal uplift changes between treatments, thereby accurately estimating the uplift of different treatments and tasks in an end-to-end manner. - **Evaluation**: Demonstrates the effectiveness of the proposed model using public datasets and large-scale product datasets (containing multiple tasks and treatments). Results show that MTMT significantly outperforms its competitors. The model has been deployed on our online gaming platform, serving millions of users. ### Summary By proposing the MTMT framework, this paper addresses key issues in multi-treatment multi-task uplift modeling, providing more accurate and detailed treatment effect estimation, thereby enhancing user growth and business outcomes.

Multi-Treatment Multi-Task Uplift Modeling for Enhancing User Growth

Entire Chain Uplift Modeling with Context-Enhanced Learning for Intelligent Marketing

Uplift Modeling for Multiple Treatments with Cost Optimization

M$^3$TN: Multi-gate Mixture-of-Experts based Multi-valued Treatment Network for Uplift Modeling

Multiple Instance Learning for Uplift Modeling

Enhancing Uplift Modeling in Multi-Treatment Marketing Campaigns: Leveraging Score Ranking and Calibration Techniques

Uplift Modeling with Multiple Treatments and General Response Types

Multi-source Data Multi-task Learning for Profiling Players in Online Games

Explicit Feature Interaction-aware Uplift Network for Online Marketing

A New Transformation Approach for Uplift Modeling with Binary Outcome

Rankability-enhanced Revenue Uplift Modeling Framework for Online Marketing

KDSM: An uplift modeling framework based on knowledge distillation and sample matching

Modeling User Engagement in Mobile Content Consumption with Tapstream Data.

Mixture of Virtual-Kernel Experts for Multi-Objective User Profile Modeling

A Policy Gradient Method with Variance Reduction for Uplift Modeling.

UTBoost: Gradient Boosted Decision Trees for Uplift Modeling

GMTL: A GART Based Multi-task Learning Model for Multi-Social-Temporal Prediction in Online Games

Modeling the Sequential Dependence among Audience Multi-step Conversions with Multi-task Learning in Targeted Display Advertising.

Personalized Mobile Targeting with User Engagement Stages: Combining a Structural Hidden Markov Model and Field Experiment

Reinforcement Learning for Uplift Modeling

Interpretable Multiple Treatment Revenue Uplift Modeling