Neural News Recommendation with Multi-Head Self-Attention.

Chuhan Wu,Fangzhao Wu,Suyu Ge,Tao Qi,Yongfeng Huang,Xing Xie

DOI: https://doi.org/10.18653/v1/d19-1671

2019-01-01

Abstract:News recommendation can help users find interested news and alleviate information overload. Precisely modeling news and users is critical for news recommendation, and capturing the contexts of words and news is important to learn news and user representations. In this paper, we propose a neural news recommendation approach with multi-head self-attention (NRMS). The core of our approach is a news encoder and a user encoder. In the news encoder, we use multi-head self-attentions to learn news representations from news titles by modeling the interactions between words. In the user encoder, we learn representations of users from their browsed news and use multi-head self-attention to capture the relatedness between the news. Besides, we apply additive attention to learn more informative news and user representations by selecting important words and news. Experiments on a real-world dataset validate the effectiveness and efficiency of our approach.