Abstract:Click-through rate prediction is one of the core tasks in commercial recommender systems. It aims to predict the prob-ability of a user clicking a particular item given user and item features. As feature interactions bring in non-linearity, they are widely adopted to improve the performance of CTR prediction models. Therefore, effectively modelling feature interactions has attracted much attention in both the research and industry field. The current approaches can generally be categorized into three classes: (i) naïve methods, which do not model feature interactions and only use original features; (ii) memorized methods, which memorize feature interactions by explicitly viewing them as new features and assigning trainable embeddings; (iii) factorized meth-ods, which learn latent vectors for original features and implicitly model feature interactions through factorization functions. Studies have shown that modelling feature interactions by one of these methods alone are suboptimal due to the unique characteristics of different feature interactions. To address this issue, we first propose a general framework called OptInter which finds the most suitable modelling method for each feature interaction. Different state-of-the-art deep CTR models can be viewed as instances of OptInter. To realize the functionality of OptInter, we also introduce a learning algorithm that automatically searches for the optimal modelling method. We conduct extensive experiments on four large datasets, including three public and one private. Experimental results demonstrate the effectiveness of OptInter. Because our OptInter finds the optimal modelling method for each feature interaction, our experiments show that OptInter improves the best performed state-of-the-art baseline deep CTR models by up to 2.21%. Compared to the memorized method, which also outperforms baselines, we reduce up to 91% parameters. In addition, we conduct several ablation studies to investigate the influence of different components of OptInter. Finally, we provide interpretable discussions on the results of OptInter.

FLIP: Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Prediction

CTRL: Connect Collaborative and Language Model for CTR Prediction

CELA: Cost-Efficient Language Model Alignment for CTR Prediction

ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Prediction

BERT4CTR: An Efficient Framework to Combine Pre-trained Language Model with Non-textual Features for CTR Prediction

MCRF: Enhancing CTR Prediction Models Via Multi-channel Feature Refinement Framework

A Comprehensive Summarization and Evaluation of Feature Refinement Modules for CTR Prediction

CL4CTR: A Contrastive Learning Framework for CTR Prediction.

Enhancing CTR Prediction with Context-Aware Feature Representation Learning

Continual Learning for CTR Prediction: A Hybrid Approach

FLEN: Leveraging Field for Scalable CTR Prediction

Memorize, Factorize, or be Naïve: Learning Optimal Feature Interaction Methods for CTR Prediction

Learning Supplementary NLP Features for CTR Prediction in Sponsored Search

Memorize, Factorize, or Be Naive: Learning Optimal Feature Interaction Methods for CTR Prediction

Balancing Efficiency and Effectiveness: An LLM-Infused Approach for Optimized CTR Prediction

MAP: A Model-agnostic Pretraining Framework for Click-through Rate Prediction

CowClip: Reducing CTR Prediction Model Training Time from 12 hours to 10 minutes on 1 GPU

Neighbour Interaction based Click-Through Rate Prediction via Graph-masked Transformer

Deep interaction network based CTR prediction model

Deep Presentation Bias Integrated Framework for CTR Prediction

PPM : A Pre-trained Plug-in Model for Click-through Rate Prediction