Abstract:Click-through rate (CTR) prediction is crucial for computing advertisement and recommender systems. The key challenge of CTR prediction is to accurately capture user interests and deliver suitable advertisements to the right people. However, there are an immense number of features in CTR prediction datasets, which hardly fit when only using an individual feature. To solve this problem, feature interaction that combines several features via an operation is introduced to enhance prediction performance. Many factorizations machine-based models and deep learning methods have been proposed to capture feature interaction for CTR prediction. They follow an enumeration-filter pattern that could not determine the appropriate order of feature interaction and useful feature interaction. The attention logarithmic network (ALN) is presented in this paper, which uses logarithmic neural networks (LNN) to model feature interactions, and the squeeze excitation (SE) mechanism to adaptively model the importance of higher-order feature interactions. At first, the embedding vector of the input was absolutized and a very small positive number was added to the zeros of the embedding vector, which made the LNN input positive. Then, the adaptive-order feature interactions were learned by logarithmic transformation and exponential transformation in the LNN. Finally, SE was applied to model the importance of high-order feature interactions adaptively for enhancing CTR performance. Based on this, the attention logarithmic interaction network (ALIN) was proposed for the effectiveness and accuracy of CTR, which integrated Newton's identity into ALN. ALIN supplements the loss of information, which is caused by the operation becoming positive and by adding a small positive value to the embedding vector. Experiments are conducted on two datasets, and the results prove that ALIN is efficient and effective.

FINET: Fine-grained Feature Interaction Network for Click-through Rate Prediction

Click-Through Rate Prediction Algorithm Based on Modeling of Implicit High-Order Feature Importance

Feature Interaction based Neural Network for Click-Through Rate Prediction

An Efficient Deep Interaction Network for Click-Through Rate Prediction.

UFIN: Universal Feature Interaction Network for Multi-Domain Click-Through Rate Prediction

Field-Aware Neural Factorization Machine for Click-Through Rate Prediction

FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Prediction

Feature Generation by Convolutional Neural Network for Click-Through Rate Prediction

Se-xDeepFEFM: Combining Low-Order Feature Refinement and Interaction Intensity Evaluation for Click-Through Rate Prediction.

DRIN: Deep Recurrent Interaction Network for Click-Through Rate Prediction

HoINT: Learning Explicit and Implicit High-order Feature Interactions for Click-through Rate Prediction

GFEN: Graph Feature Extract Network for Click-Through Rate Prediction.

Feature Aware and Bilinear Feature Equal Interaction Network for Click-Through Rate Prediction.

Deep Field Relation Neural Network for click-through rate prediction

Graph Relation Embedding Network for Click-Through Rate Prediction

Click-Through Rate Prediction Combining Mutual Information Feature Weighting and Feature Interaction

Deep & Attentional Crossing Network for Click-through Rate Prediction

A Click-Through Rate Prediction Method Based on Cross-Importance of Multi-Order Features

Coarse-to-fine: A dual-view attention network for click-through rate prediction

Feature Interaction Fusion Self-Distillation Network For CTR Prediction

A Dual Adaptive Interaction Click-Through Rate Prediction Based on Attention Logarithmic Interaction Network