Abstract:Personalized news recommendation aims to help users find their interested news, which has attracted more and more attention recently. There are two core issues of news recommendation: learning news representation, and matching candidate news with user interests. Due to the superior natural language understanding ability of Pre-trained Language Models (PLMs), recent works utilize PLMs (e.g., BERT) to strengthen news modeling, further obtain more accurate user interest matching and achieve notable improvement in news recommendation. However, the existing PLM-based methods are usually incapable of fully exploring the fine-grained (e.g., word-level) relatedness between user behaviors and candidate news due to the heavy computational cost brought by PLMs. In this paper, we propose a group-based personalized news recommendation method with long- and short-term matching mechanisms between users and candidate news based on PLMs to learn fine-grained matching efficiently and effectively. In our approach, we design to group user historical clicked news into chunks with quite shorter news sequences according to their clicked timestamps, which could alleviate the computation issues of PLMs. PLMs are applied in each group jointly with the candidate news to capture their word-level interaction, and global group-level matching is learned across different groups. In addition, the group-based mechanism could be naturally adapted for long- and short-term user representation learning, where we build users’ long preferences from the representations of all groups and treat the last group as short interests respectively. Finally, we employ a gate network to dynamically unify the group-level, long- and short-term representations, yielding comprehensive user-news matching effectively. Extensive experiments are conducted on two real-world datasets and the results show that our proposed method achieves superior performance in news recommendations.

MTRec: Multi-Task Learning over BERT for News Recommendation.

A BERT-based Ensemble Model for Chinese News Topic Prediction

Training Large-Scale News Recommenders with Pretrained Language Models in the Loop

NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application

Tiny-NewsRec: Effective and Efficient PLM-based News Recommendation

Knowledge-aware user multi-interest modeling method for news recommendation

Multi-Task Learning for Recommendation Over Heterogeneous Information Network

TrNews: Heterogeneous User-Interest Transfer Learning for News Recommendation

News Recommendation With Word-Related Joint Topic Prediction

Personalized Multi-task Training for Recommender System

CAT-BERT: A Context-Aware Transferable BERT Model for Multi-turn Machine Reading Comprehension.

Multi-Task Recommendations with Reinforcement Learning

Neural News Recommendation with Multi-Head Self-Attention.

NRMG: News Recommendation with Multiview Graph Convolutional Networks

Efficient Multi-task Prompt Tuning for Recommendation

Group-based Personalized News Recommendation with Long- and Short-term Fine-Grained Matching

MNN4Rec: A relation-aware approach based on multi-view news network for news recommendation

A Multi-Channel Text Sentiment Analysis Model Integrating Pre-training Mechanism

Multi-Task Learning in Natural Language Processing: An Overview

An End-to-End Scalable Iterative Sequence Tagging with Multi-Task Learning.

Fine-Grained Deep Knowledge-Aware Network for News Recommendation with Self-Attention