AutoTask: Task Aware Multi-Faceted Single Model for Multi-Task Ads Relevance

Shouchang Guo,Sonam Damani,Keng-hao Chang

2024-07-09

Abstract:Ads relevance models are crucial in determining the relevance between user search queries and ad offers, often framed as a classification problem. The complexity of modeling increases significantly with multiple ad types and varying scenarios that exhibit both similarities and differences. In this work, we introduce a novel multi-faceted attention model that performs task aware feature combination and cross task interaction modeling. Our technique formulates the feature combination problem as "language" modeling with auto-regressive attentions across both feature and task dimensions. Specifically, we introduce a new dimension of task ID encoding for task representations, thereby enabling precise relevance modeling across diverse ad scenarios with substantial improvement in generality capability for unseen tasks. We demonstrate that our model not only effectively handles the increased computational and maintenance demands as scenarios proliferate, but also outperforms generalized DNN models and even task-specific models across a spectrum of ad applications using a single unified model.

Information Retrieval,Artificial Intelligence,Computation and Language,Machine Learning

What problem does this paper attempt to address?

The paper attempts to address the multi-task classification problem in ad relevance modeling. Specifically, the main challenges faced by the research team include:

1. **Diverse Ad Scenarios**: With the increase in ad types, it is necessary to handle the complexity brought by different user search behaviors and various ad attributes.
2. **Single Task Inference**: In practical applications, it is required to evaluate the relevance of a single ad type at a time, rather than handling all tasks simultaneously.
3. **Generalization Ability**: The model needs to have good generalization ability to cope with new, unseen ad types.
4. **Efficiency and Compactness**: To meet the needs of online services, the model needs to be lightweight and efficient.

To address these issues, the authors propose a new Multi-Faceted Single Model, which achieves cross-task feature combination and interaction modeling by introducing task ID encoding and an autoregressive attention mechanism. This approach not only improves the model's performance on known tasks but also significantly enhances its generalization ability to unknown tasks. Experimental results show that this model outperforms traditional general models and specific task models in multiple ad scenarios and performs excellently on unseen tasks.