Abstract:Click-through rate (CTR) prediction plays an important role in many industrial applications, feature engineering directly influences CTR prediction performance because features are normally the multi-field type. However, the existing CTR prediction techniques either neglect the importance of each feature or regard the feature interactions equally for feature learning. In addition, using an inner product or a Hadamard product is too simple to effectively model the feature interactions. These limitations lead to suboptimal performances of existing models. In this paper, we propose a framework called Hierarchical Attention and Feature Projection neural network (HAFP) for CTR prediction, which enables the automatically learning of more representative and efficient feature representation in an end-to-end manner. Towards this end, we employ a feature learning layer with a hierarchical attention mechanism to jointly extract more generalized and dominant features and feature interactions. In addition, a projective bilinear function is designed in meaningful second-order interaction encoder to effectively learn more fine-grained and comprehensive second-order feature interactions. Taking advantages of the hierarchical attention mechanism and the projective bilinear function, our proposed model can not only model feature learning in a flexible fashion, but also provide an interpretable capability of the prediction results. Experimental results on two real-world datasets demonstrate that HAFP outperforms the state-of-the-art in terms of Logloss and AUC for CTR prediction baselines. Further analysis verifies the importance of the proposed hierarchical attention mechanism and the projective bilinear function for modelling the feature representation, showing the rationality and effectiveness of HAFP.

Forecasting CPI Inflation Components with Hierarchical Recurrent Neural Networks

Predicting Inflation with Recurrent Neural Networks

Forecasting Inflation Using Economic Narratives

Forecasting Inflation with Economic Narratives and Machine Learning

Inflation Prediction Method Based on Deep Learning

Forecasting UK inflation bottom up

Forecasting in Data-Rich Environments: An Application to Inflation Rates

Accurate Stock Price Forecasting Based on Deep Learning and Hierarchical Frequency Decomposition

N-HiTS: Neural Hierarchical Interpolation for Time Series Forecasting

Real-time Inflation Forecasting Using Non-linear Dimension Reduction Techniques

DeepHGNN: Study of Graph Neural Network based Forecasting Methods for Hierarchically Related Multivariate Time Series

Hierarchical Attention and Feature Projection for Click-Through Rate Prediction

Using deep (machine) learning to forecast US inflation in the COVID‐19 era

China's inflation forecasting in a data-rich environment: based on machine learning algorithms

Hierarchically Regularized Deep Forecasting

Hierarchical Neural Additive Models for Interpretable Demand Forecasts

Forecasting Horticultural Products Price Using ARIMA Model and Neural Network Based on a Large-Scale Data Set Collected by Web Crawler

Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods

Interpretable Click-Through Rate Prediction through Hierarchical Attention

Multi-task Recurrent Neural Networks and Higher-order Markov Random Fields for Stock Price Movement Prediction

A machine learning approach for forecasting hierarchical time series