Abstract:In an era of information explosion, recommendation systems play an important role in people’s daily life by facilitating content exploration. It is known that user activeness, i.e., number of behaviors, tends to follow a long-tail distribution, where the majority of users are with low activeness. In practice, we observe that tail users suffer from significantly lower-quality recommendation than the head users after joint training. We further identify that a model trained on tail users separately still achieve inferior results due to limited data. Though long-tail distributions are ubiquitous in recommendation systems, improving the recommendation performance on the tail users still remains challenge in both research and industry. Directly applying related methods on long-tail distribution might be at risk of hurting the experience of head users, which is less affordable since a small portion of head users with high activeness contribute a considerate portion of platform revenue. In this paper, we propose a novel approach that significantly improves the recommendation performance of the tail users while achieving at least comparable performance for the head users over the base model. The essence of this approach is a novel Gradient Aggregation technique that learns common knowledge shared by all users into a backbone model, followed by separate plugin prediction networks for the head users and the tail users personalization. As for common knowledge learning, we leverage the backward adjustment from the causality theory for deconfounding the gradient estimation and thus shielding off the backbone training from the confounder, i.e., user activeness. We conduct extensive experiments on two public recommendation benchmark datasets and a large-scale industrial datasets collected from the Alipay platform. Empirical studies validate the rationality and effectiveness of our approach.

Meta Learning Framework for Improved Long-tail Item Recommendation

MetaGA: Metalearning with Graph-Attention for Improved Long-Tail Item Recommendation

A General Tail Item Representation Enhancement Framework for Sequential Recommendation

Parameters Efficient Fine-Tuning for Long-Tailed Sequential Recommendation.

GACRec: Generative Adversarial Contrastive Learning for Improved Long-Tail Item Recommendation

ICMT: Item Cluster-Wise Multi-Objective Training for Long-Tail Recommendation.

MetaKRec: Collaborative Meta-Knowledge Enhanced Recommender System

MetaSelector: Meta-Learning for Recommendation with User-Level Adaptive Model Selection

Improving the Quality of Recommendations for Users and Items in the Tail of Distribution

RLRF4Rec: Reinforcement Learning from Recsys Feedback for Enhanced Recommendation Reranking

Personalizing Intervened Network for Long-tailed Sequential User Behavior Modeling

Long Short-Term Temporal Meta-learning in Online Recommendation

An improved sequential recommendation model based on spatial self-attention mechanism and meta learning

Long-tail recommendation model based on adaptive group reranking

How to Retrain Recommender System? A Sequential Meta-Learning Method

ATFLRec: A Multimodal Recommender System with Audio-Text Fusion and Low-Rank Adaptation via Instruction-Tuned Large Language Model

Contrastive Meta Learning with Behavior Multiplicity for Recommendation

RGMeta: Enhancing Cold-Start Recommendations with a Residual Graph Meta-Embedding Model

AdaML: an Adaptive Meta-Learning Model Based on User Relevance for User Cold-Start Recommendation.

A Multi-facet Paradigm to Bridge Large Language Model and Recommendation

Long-tail Augmented Graph Contrastive Learning for Recommendation