Abstract:Owing to the impressive general intelligence of large language models (LLMs), there has been a growing trend to integrate them into recommender systems to gain a more profound insight into human interests and intentions. Existing LLMs-based recommender systems primarily leverage item attributes and user interaction histories in textual format, improving the single task like rating prediction or explainable recommendation. Nevertheless, these approaches overlook the crucial contribution of traditional collaborative signals in discerning users' profound intentions and disregard the interrelatedness among tasks. To address these limitations, we introduce a novel framework known as CKF, specifically developed to boost multi-task recommendations via personalized collaborative knowledge fusion into LLMs. Specifically, our method synergizes traditional collaborative filtering models to produce collaborative embeddings, subsequently employing the meta-network to construct personalized mapping bridges tailored for each user. Upon mapped, the embeddings are incorporated into meticulously designed prompt templates and then fed into an advanced LLM to represent user interests. To investigate the intrinsic relationship among diverse recommendation tasks, we develop Multi-Lora, a new parameter-efficient approach for multi-task optimization, adept at distinctly segregating task-shared and task-specific information. This method forges a connection between LLMs and recommendation scenarios, while simultaneously enriching the supervisory signal through mutual knowledge transfer among various tasks. Extensive experiments and in-depth robustness analyses across four common recommendation tasks on four large public data sets substantiate the effectiveness and superiority of our framework.

Deep Mutual Learning across Task Towers for Effective Multi-Task Recommender Learning

Collaborative Knowledge Fusion: A Novel Approach for Multi-task Recommender Systems via LLMs

DMMP: A distillation-based multi-task multi-tower learning model for personalized recommendation

Multi-Faceted Hierarchical Multi-Task Learning for a Large Number of Tasks with Multi-dimensional Relations

AdaTT: Adaptive Task-to-Task Fusion Network for Multitask Learning in Recommendations

Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation

Personalized Multi-task Training for Recommender System

DTN: Deep Multiple Task-specific Feature Interactions Network for Multi-Task Recommendation

Multi-Task Recommendation with Task Information Decoupling

Adaptively Sharing Multi-Levels of Distributed Representations in Multi-Task Learning

Cross-Task Knowledge Distillation in Multi-Task Recommendation

Efficient Multi-task Prompt Tuning for Recommendation

Disaggregated Multi-Tower: Topology-aware Modeling Technique for Efficient Large-Scale Recommendation

Towards Personalized Federated Multi-Scenario Multi-Task Recommendation

Meta-Learning for Recommendation System with the Multi-Tasking Learning Setting

DCRNN: A Deep Cross approach based on RNN for Partial Parameter Sharing in Multi-task Learning

Automatic Multi-Task Learning Framework with Neural Architecture Search in Recommendations

Multi-Task Deep Recommender Systems: A Survey

Multi-task Feature Learning for Social Recommendation

MultiBalance: Multi-Objective Gradient Balancing in Industrial-Scale Multi-Task Recommendation System

Developing Multi-Task Recommendations with Long-Term Rewards via Policy Distilled Reinforcement Learning