Abstract:Click-Through Rate (CTR) prediction, which aims to estimate the probability that a user will click an item, is an essential component of online advertising. Existing methods mainly attempt to mine user interests from users' historical behaviours, which contain users' directly interacted items. Although these methods have made great progress, they are often limited by the recommender system's direct exposure and inactive interactions, and thus fail to mine all potential user interests. To tackle these problems, we propose Neighbor-Interaction based CTR prediction (NI-CTR), which considers this task under a Heterogeneous Information Network (HIN) setting. In short, Neighbor-Interaction based CTR prediction involves the local neighborhood of the target user-item pair in the HIN to predict their linkage. In order to guide the representation learning of the local neighbourhood, we further consider different kinds of interactions among the local neighborhood nodes from both explicit and implicit perspective, and propose a novel Graph-Masked Transformer (GMT) to effectively incorporates these kinds of interactions to produce highly representative embeddings for the target user-item pair. Moreover, in order to improve model robustness against neighbour sampling, we enforce a consistency regularization loss over the neighbourhood embedding. We conduct extensive experiments on two real-world datasets with millions of instances and the experimental results show that our proposed method outperforms state-of-the-art CTR models significantly. Meanwhile, the comprehensive ablation studies verify the effectiveness of every component of our model. Furthermore, we have deployed this framework on the WeChat Official Account Platform with billions of users. The online A/B tests demonstrate an average CTR improvement of 21.9 against all online baselines.

BERT4SessRec

Content-Based Video Relevance Prediction with Second-Order Relevance and Attention Modeling

Content-based Video Relevance Prediction Challenge: Data, Protocol, and Baseline

Click-Through Rate Prediction with Multi-Modal Hypergraphs

BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer

Enhancing CTR Prediction through Sequential Recommendation Pre-training: Introducing the SRP4CTR Framework

ContentCTR: Frame-level Live Streaming Click-Through Rate Prediction with Multimodal Transformer

Practice on Effectively Extracting NLP Features for Click-Through Rate Prediction

Algorithm for Video Click-Through Rate Prediction

Enhancing CTR Prediction in Recommendation Domain with Search Query Representation

Preference-Aware Mask for Session-Based Recommendation with Bidirectional Transformer

KAST: Knowledge Aware Adaptive Session Multi-Topic Network for Click-Through Rate Prediction

IceBreaker: Solving Cold Start Problem for Video Recommendation Engines

U-BERT: Pre-training User Representations for Improved Recommendation

Streaming CTR Prediction: Rethinking Recommendation Task for Real-World Streaming Data

Neighbour Interaction based Click-Through Rate Prediction via Graph-masked Transformer

DisenCTR: Dynamic Graph-based Disentangled Representation for Click-Through Rate Prediction

BERT4CTR: An Efficient Framework to Combine Pre-trained Language Model with Non-textual Features for CTR Prediction

COURIER: Contrastive User Intention Reconstruction for Large-Scale Visual Recommendation

End-to-End User Behavior Retrieval in Click-Through RatePrediction Model

Visual Encoding and Debiasing for CTR Prediction