Abstract:Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains, thereby prompting researchers to explore their potential for use in recommendation systems. Initial at-tempts have leveraged the exceptional capabilities of LLMs, such as rich knowledge and strong gener-alization through In-context Learning, which involves phrasing the recommendation task as prompts.Nevertheless, Given the significant disparity between the training tasks of LLMs and recom-mendation tasks, along with the data sparsity issue arising from insufficient recommendation data during pre-training, the performance of LLMs in recommendation tasks remains unsatisfactory. To bridge this gap, we propose fine-tuning LLMs with Contrastive Learning-optimized recommendation data to Construct a Language Model Recommendation. namely CLCLMRec. The CLCLMRec frame-work aims to achieve an effective and efficient integration of Large Language Models with recommen-dation systems in settings with low GPU memory consumption. The framework encompasses two cru-cial tuning phases: firstly, instruction tuning, a universal LLM training process designed to enhance the generalization capabilities of LLMs; and secondly, recommendation tuning, which focuses on fine-tuning the model specifically for recommendation tasks. In Rec-tuning, we employ the self-attention mechanism to process embedded data and emphasize sequential recommendation methods to capture users' dynamic interests. However, addressing the challenge of data sparsity, we innovatively intro-duce contrastive learning, extracting self-supervised signals from user behavior sequences to train large models more effectively and uncover meaningful user patterns. Ultimately, we fuse "recommen-dation instructions" with "recommendation inputs" to construct "instruction inputs" and utilize "rec-ommendation outputs" as "instruction outputs" for training, thereby building a Large Recommendation Language Model (LRLM). Experimental results demonstrate that even with extremely limited data (fewer than 100 samples), the CLCLMRec framework can significantly boost the recommendation ca-pabilities of LLMs in domains such as movies and books.

Learnable Model Augmentation Contrastive Learning for Sequential Recommendation

Meta-optimized Contrastive Learning for Sequential Recommendation

MCL4SRec: A Sequential Recommendation Model with Multi-level Contrastive Learning

Equivariant Contrastive Learning for Sequential Recommendation

Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential Recommendation

Noise-Augmented Contrastive Learning for Sequential Recommendation.

Explanation Guided Contrastive Learning for Sequential Recommendation

Meta-Optimized Joint Generative and Contrastive Learning for Sequential Recommendation.

Hierarchical Contrastive Learning with Multiple Augmentation for Sequential Recommendation

Relative Contrastive Learning for Sequential Recommendation with Similarity-based Positive Sample Selection

CCL4Rec: Contrast over Contrastive Learning for Micro-video Recommendation

Reliable Data Augmented Contrastive Learning for Sequential Recommendation

Contrastive Learning with Reverse Extended Enhancement for Sequential Recommendation

Multi-level Contrastive Learning Framework for Sequential Recommendation

Simple Debiased Contrastive Learning for Sequential Recommendation

Contrastive Learning-optimized Recommendation Data to Construct a Language Model Recommendation

Multi-behavior collaborative contrastive learning for sequential recommendation

MoCo4SRec: A momentum contrastive learning framework for sequential recommendation

Item Attribute-Aware Contrastive Learning for Sequential Recommendation

Contrastive Self-supervised Sequential Recommendation with Robust Augmentation

Soft Contrastive Sequential Recommendation