Abstract:Click-through rate prediction is one of the core tasks in commercial recommender systems. It aims to predict the prob-ability of a user clicking a particular item given user and item features. As feature interactions bring in non-linearity, they are widely adopted to improve the performance of CTR prediction models. Therefore, effectively modelling feature interactions has attracted much attention in both the research and industry field. The current approaches can generally be categorized into three classes: (i) naïve methods, which do not model feature interactions and only use original features; (ii) memorized methods, which memorize feature interactions by explicitly viewing them as new features and assigning trainable embeddings; (iii) factorized meth-ods, which learn latent vectors for original features and implicitly model feature interactions through factorization functions. Studies have shown that modelling feature interactions by one of these methods alone are suboptimal due to the unique characteristics of different feature interactions. To address this issue, we first propose a general framework called OptInter which finds the most suitable modelling method for each feature interaction. Different state-of-the-art deep CTR models can be viewed as instances of OptInter. To realize the functionality of OptInter, we also introduce a learning algorithm that automatically searches for the optimal modelling method. We conduct extensive experiments on four large datasets, including three public and one private. Experimental results demonstrate the effectiveness of OptInter. Because our OptInter finds the optimal modelling method for each feature interaction, our experiments show that OptInter improves the best performed state-of-the-art baseline deep CTR models by up to 2.21%. Compared to the memorized method, which also outperforms baselines, we reduce up to 91% parameters. In addition, we conduct several ablation studies to investigate the influence of different components of OptInter. Finally, we provide interpretable discussions on the results of OptInter.

Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization

Click-Through Rate Prediction Algorithm Based on Modeling of Implicit High-Order Feature Importance

Continual Learning for CTR Prediction: A Hybrid Approach

BarsCTR: Open Benchmarking for Click-Through Rate Prediction

A CTR Prediction Model with Double Matrix-Level Cross-Features

Balancing Efficiency and Effectiveness: An LLM-Infused Approach for Optimized CTR Prediction

BARS-CTR: Open Benchmarking for Click-Through Rate Prediction

EXTR: Click-Through Rate Prediction with Externalities in E-Commerce Sponsored Search

TMH: Two-Tower Multi-Head Attention neural network for CTR prediction

Memorize, Factorize, or be Naïve: Learning Optimal Feature Interaction Methods for CTR Prediction

Looking at CTR Prediction Again: Is Attention All You Need?

Memorize, Factorize, or Be Naive: Learning Optimal Feature Interaction Methods for CTR Prediction

Research on CTR Prediction Based on Deep Learning

Unified Low-rank Compression Framework for Click-through Rate Prediction

Understanding and Counteracting Feature-Level Bias in Click-Through Rate Prediction

CowClip: Reducing CTR Prediction Model Training Time from 12 hours to 10 minutes on 1 GPU

Confidence Ranking for CTR Prediction

Deep interaction network based CTR prediction model

Interpretable Click-Through Rate Prediction through Hierarchical Attention

A Hierarchical Attention Model for CTR Prediction Based on User Interest