Abstract:Natural content and advertisement coexist in industrial recommendation systems but differ in data distribution. Concretely, traffic related to the advertisement is considerably sparser compared to that of natural content, which motivates the development of transferring knowledge from the richer source natural content domain to the sparser advertising domain. The challenges include the inefficiencies arising from the management of extensive source data and the problem of 'catastrophic forgetting' that results from the CTR model's daily updating. To this end, we propose a novel tri-level asynchronous framework, i.e., Efficient Transfer Learning Framework for Cross-Domain Click-Through Rate Prediction (E-CDCTR), to transfer comprehensive knowledge of natural content to advertisement CTR models. This framework consists of three key components: Tiny Pre-training Model ((TPM), which trains a tiny CTR model with several basic features on long-term natural data; Complete Pre-training Model (CPM), which trains a CTR model holding network structure and input features the same as target advertisement on short-term natural data; Advertisement CTR model (A-CTR), which derives its parameter initialization from CPM together with multiple historical embeddings from TPM as extra feature and then fine-tunes on advertisement data. TPM provides richer representations of user and item for both the CPM and A-CTR, effectively alleviating the forgetting problem inherent in the daily updates. CPM further enhances the advertisement model by providing knowledgeable initialization, thereby alleviating the data sparsity challenges typically encountered by advertising CTR models. Such a tri-level cross-domain transfer learning framework offers an efficient solution to address both data sparsity and `catastrophic forgetting', yielding remarkable improvements.

Warm Up Cold-start Advertisements

Click-Through Rate Prediction Algorithm Based on Modeling of Implicit High-Order Feature Importance

Cold Start on Online Advertising Platforms: Data-Driven Algorithms and Field Experiments

Learning Graph Meta Embeddings for Cold-Start Ads in Click-Through Rate Prediction

GACE: Learning Graph-Based Cross-Page Ads Embedding For Click-Through Rate Prediction

Boost CTR Prediction for New Advertisements via Modeling Visual Content

Deep CTR Prediction in Display Advertising

What You Look Matters? Offline Evaluation Of Advertising Creatives For Cold-Start Problem

A New Approach for Advertising CTR Prediction Based on Deep Neural Network via Attention Mechanism

Deep Spatio-Temporal Neural Networks for Click-Through Rate Prediction

An accuracy improving method for advertising click through rate prediction based on enhanced xDeepFM model

Warming Up Cold-Start CTR Prediction by Learning Item-Specific Feature Interactions

Research on CTR Prediction Based on Deep Learning

Improving Click-Through Rate Prediction Accuracy in Online Advertising by Transfer Learning.

Cold-Start based Multi-Scenario Ranking Model for Click-Through Rate Prediction

Efficient Transfer Learning Framework for Cross-Domain Click-Through Rate Prediction

Regularized Adversarial Sampling and Deep Time-aware Attention for Click-Through Rate Prediction

Rec4Ad: A Free Lunch to Mitigate Sample Selection Bias for Ads CTR Prediction in Taobao

A joint learning model for click-through prediction in display advertising