Abstract:Click-through rate prediction is one of the core tasks in commercial recommender systems. It aims to predict the prob-ability of a user clicking a particular item given user and item features. As feature interactions bring in non-linearity, they are widely adopted to improve the performance of CTR prediction models. Therefore, effectively modelling feature interactions has attracted much attention in both the research and industry field. The current approaches can generally be categorized into three classes: (i) naïve methods, which do not model feature interactions and only use original features; (ii) memorized methods, which memorize feature interactions by explicitly viewing them as new features and assigning trainable embeddings; (iii) factorized meth-ods, which learn latent vectors for original features and implicitly model feature interactions through factorization functions. Studies have shown that modelling feature interactions by one of these methods alone are suboptimal due to the unique characteristics of different feature interactions. To address this issue, we first propose a general framework called OptInter which finds the most suitable modelling method for each feature interaction. Different state-of-the-art deep CTR models can be viewed as instances of OptInter. To realize the functionality of OptInter, we also introduce a learning algorithm that automatically searches for the optimal modelling method. We conduct extensive experiments on four large datasets, including three public and one private. Experimental results demonstrate the effectiveness of OptInter. Because our OptInter finds the optimal modelling method for each feature interaction, our experiments show that OptInter improves the best performed state-of-the-art baseline deep CTR models by up to 2.21%. Compared to the memorized method, which also outperforms baselines, we reduce up to 91% parameters. In addition, we conduct several ablation studies to investigate the influence of different components of OptInter. Finally, we provide interpretable discussions on the results of OptInter.

Temporal Importance Factor for Loss Functions for CTR Prediction

Click-Through Rate Prediction Algorithm Based on Modeling of Implicit High-Order Feature Importance

Residual Connections Improve Prediction Performance

Deep Time-Stream Framework for Click-Through Rate Prediction by Tracking Interest Evolution

Memorize, Factorize, or be Naïve: Learning Optimal Feature Interaction Methods for CTR Prediction

Time-aligned Exposure-enhanced Model for Click-Through Rate Prediction

Memorize, Factorize, or Be Naive: Learning Optimal Feature Interaction Methods for CTR Prediction

Deep Spatio-Temporal Neural Networks for Click-Through Rate Prediction

TF4CTR: Twin Focus Framework for CTR Prediction via Adaptive Sample Differentiation

Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization

Regularized Adversarial Sampling and Deep Time-aware Attention for Click-Through Rate Prediction

Reformulating CTR Prediction: Learning Invariant Feature Interactions for Recommendation

End-to-End User Behavior Retrieval in Click-Through RatePrediction Model

Continual Learning for CTR Prediction: A Hybrid Approach

Click-aware Structure Transfer with Sample Weight Assignment for Post-Click Conversion Rate Estimation

Graph Based Long-Term And Short-Term Interest Model for Click-Through Rate Prediction

The Effects of Data Split Strategies on the Offline Experiments for CTR Prediction

A CTR Prediction Model with Double Matrix-Level Cross-Features

FAN: Fatigue-Aware Network for Click-Through Rate Prediction in E-commerce Recommendation

A joint learning model for click-through prediction in display advertising

Pairwise Ranking Losses of Click-Through Rates Prediction for Welfare Maximization in Ad Auctions