Abstract:Click-through rate prediction is one of the core tasks in commercial recommender systems. It aims to predict the prob-ability of a user clicking a particular item given user and item features. As feature interactions bring in non-linearity, they are widely adopted to improve the performance of CTR prediction models. Therefore, effectively modelling feature interactions has attracted much attention in both the research and industry field. The current approaches can generally be categorized into three classes: (i) naïve methods, which do not model feature interactions and only use original features; (ii) memorized methods, which memorize feature interactions by explicitly viewing them as new features and assigning trainable embeddings; (iii) factorized meth-ods, which learn latent vectors for original features and implicitly model feature interactions through factorization functions. Studies have shown that modelling feature interactions by one of these methods alone are suboptimal due to the unique characteristics of different feature interactions. To address this issue, we first propose a general framework called OptInter which finds the most suitable modelling method for each feature interaction. Different state-of-the-art deep CTR models can be viewed as instances of OptInter. To realize the functionality of OptInter, we also introduce a learning algorithm that automatically searches for the optimal modelling method. We conduct extensive experiments on four large datasets, including three public and one private. Experimental results demonstrate the effectiveness of OptInter. Because our OptInter finds the optimal modelling method for each feature interaction, our experiments show that OptInter improves the best performed state-of-the-art baseline deep CTR models by up to 2.21%. Compared to the memorized method, which also outperforms baselines, we reduce up to 91% parameters. In addition, we conduct several ablation studies to investigate the influence of different components of OptInter. Finally, we provide interpretable discussions on the results of OptInter.

Optimizing Feature Set for Click-Through Rate Prediction

Click-Through Rate Prediction Algorithm Based on Modeling of Implicit High-Order Feature Importance

Memorize, Factorize, or be Naïve: Learning Optimal Feature Interaction Methods for CTR Prediction

Memorize, Factorize, or Be Naive: Learning Optimal Feature Interaction Methods for CTR Prediction

LPFS: Learnable Polarizing Feature Selection for Click-Through Rate Prediction

Graph Relation Embedding Network for Click-Through Rate Prediction

An Efficient Deep Interaction Network for Click-Through Rate Prediction.

Feature Interaction Fusion Self-Distillation Network For CTR Prediction

Hierarchical Attention and Feature Projection for Click-Through Rate Prediction

A Click-Through Rate Prediction Method Based on Cross-Importance of Multi-Order Features

Context-aware cross feature attentive network for click-through rate predictions

Field-Aware Neural Factorization Machine for Click-Through Rate Prediction

TF4CTR: Twin Focus Framework for CTR Prediction via Adaptive Sample Differentiation

XCrossNet: Feature Structure-Oriented Learning for Click-Through Rate Prediction

Feature Generation by Convolutional Neural Network for Click-Through Rate Prediction

Towards Unifying Feature Interaction Models for Click-Through Rate Prediction

Feature Interaction based Neural Network for Click-Through Rate Prediction

Fusion Matters: Learning Fusion in Deep Click-through Rate Prediction Models

Cognitive Evolutionary Search to Select Feature Interactions for Click-Through Rate Prediction.

FLEN: Leveraging Field for Scalable CTR Prediction

NeSHFS: Neighborhood Search with Heuristic-based Feature Selection for Click-Through Rate Prediction