Abstract:Owing to the impressive general intelligence of large language models (LLMs), there has been a growing trend to integrate them into recommender systems to gain a more profound insight into human interests and intentions. Existing LLMs-based recommender systems primarily leverage item attributes and user interaction histories in textual format, improving the single task like rating prediction or explainable recommendation. Nevertheless, these approaches overlook the crucial contribution of traditional collaborative signals in discerning users' profound intentions and disregard the interrelatedness among tasks. To address these limitations, we introduce a novel framework known as CKF, specifically developed to boost multi-task recommendations via personalized collaborative knowledge fusion into LLMs. Specifically, our method synergizes traditional collaborative filtering models to produce collaborative embeddings, subsequently employing the meta-network to construct personalized mapping bridges tailored for each user. Upon mapped, the embeddings are incorporated into meticulously designed prompt templates and then fed into an advanced LLM to represent user interests. To investigate the intrinsic relationship among diverse recommendation tasks, we develop Multi-Lora, a new parameter-efficient approach for multi-task optimization, adept at distinctly segregating task-shared and task-specific information. This method forges a connection between LLMs and recommendation scenarios, while simultaneously enriching the supervisory signal through mutual knowledge transfer among various tasks. Extensive experiments and in-depth robustness analyses across four common recommendation tasks on four large public data sets substantiate the effectiveness and superiority of our framework.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve two key problems existing in the current recommendation systems based on large - language models (LLMs): 1. **Ignoring the value of traditional collaborative signals**: - Existing research mainly emphasizes the generation ability of LLMs, but often neglects traditional collaborative knowledge, such as the interaction history between users and items. These traditional signals are very important for understanding the deep - level intentions of users, while LLMs usually focus more on text semantics rather than complex user behavior patterns. - Specifically, when two items have similar properties but are preferred by different user groups, this subtle difference in consumption patterns is a challenge for LLMs that only rely on text semantics. 2. **Insufficient multi - task optimization**: - Most existing LLM - based recommendation systems focus on specific recommendation tasks, such as score prediction or click - through - rate estimation, and are unable to capture the complex associations between different tasks. However, research shows that multi - task learning can more effectively interpret user behavior. - For example, CTR estimation can reveal users' immediate interests, and score prediction can measure content quality and satisfaction. Combining the two can provide a more comprehensive view of user preferences. To solve these problems, the author proposes a new framework named CKF (Collaborative Knowledge Fusion). The specific methods are as follows: - **Personalized collaborative knowledge fusion**: By introducing the traditional collaborative filtering model to generate the embedding representations of users and items, and using the meta - network to generate personalized mapping functions, these embedding representations are seamlessly integrated into the carefully designed prompt templates, thereby enriching the collaborative knowledge. - **Multi - task optimization strategy**: A new parameter - efficient fine - tuning strategy, Multi - Lora, has been developed, which can clearly separate task - shared information and task - specific information, thereby better capturing the internal relationships between tasks and reducing the number of fine - tuning parameters required. Through this method, CKF not only enhances the performance of the recommendation system, but also enables LLMs to better handle multi - task recommendations and provide a more comprehensive understanding of user preferences.

Collaborative Knowledge Fusion: A Novel Approach for Multi-task Recommender Systems via LLMs

Improving Recommendations With Collaborative Factors

Heterogeneous Knowledge Fusion: A Novel Approach for Personalized Recommendation via LLM

Collaborative Cross-modal Fusion with Large Language Model for Recommendation

Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation

Large Language Models Enhanced Collaborative Filtering

Multi-task Feature Learning for Social Recommendation

Deep Mutual Learning across Task Towers for Effective Multi-Task Recommender Learning

Cross-Task Knowledge Distillation in Multi-Task Recommendation

Knowledge Enhancement for Contrastive Multi-Behavior Recommendation

Aligning Large Language Models with Recommendation Knowledge

Enhanced Multi-Task Learning and Knowledge Graph-Based Recommender System

MMREC: LLM Based Multi-Modal Recommender System

Collaborative Knowledge Base Embedding for Recommender Systems

Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences

Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender System

Fusion Recommendation System Based on Collaborative Filtering and Knowledge Graph.

A Unified Multi-task Learning Framework for Multi-goal Conversational Recommender Systems

Towards Open-World Recommendation with Knowledge Augmentation from Large Language Models

Triple Modality Fusion: Aligning Visual, Textual, and Graph Data with Large Language Models for Multi-Behavior Recommendations