Abstract:Large Language Models (LLMs) have achieved remarkable success in various fields, prompting several studies to explore their potential in recommendation systems. However, these attempts have so far resulted in only modest improvements over traditional recommendation models. Moreover, three critical questions remain under-explored: firstly, the real value of LLMs' pre-trained weights, often considered to encapsulate world knowledge; secondly, the necessity of fine-tuning for recommendation tasks; lastly, whether LLMs can exhibit the same scalability benefits in recommendation systems as they do in other domains. In this paper, we propose a novel Hierarchical Large Language Model (HLLM) architecture designed to enhance sequential recommendation systems. Our approach employs a two-tier model: the first Item LLM extracts rich content features from the detailed text description of the item, while the second User LLM utilizes these features to predict users' future interests based on their interaction history. Extensive experiments demonstrate that our method effectively leverages the pre-trained capabilities of open-source LLMs, and further fine-tuning leads to significant performance boosts. Additionally, HLLM achieves excellent scalability, with the largest configuration utilizing 7B parameters for both item feature extraction and user interest modeling. Moreover, HLLM offers excellent training and serving efficiency, making it practical in real-world applications. Evaluations on two large-scale datasets, PixelRec and Amazon Reviews, show that HLLM achieves state-of-the-art results, outperforming traditional ID-based models by a wide margin. In online A/B testing, HLLM showcases notable gains, validating its practical impact in real-world recommendation scenarios. Codes are available at <a class="link-external link-https" href="https://github.com/bytedance/HLLM" rel="external noopener nofollow">this https URL</a>.

Understanding the Role of Cross-Entropy Loss in Fairly Evaluating Large Language Model-based Recommendation

Are LLM-based Recommenders Already the Best? Simple Scaled Cross-entropy Unleashes the Potential of Traditional Sequential Recommenders

Unlocking the Potential of Large Language Models for Explainable Recommendations

A Survey on Large Language Models for Recommendation

HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modeling

Uncertainty-Aware Explainable Recommendation with Large Language Models

Mitigating Propensity Bias of Large Language Models for Recommender Systems

Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive Aggregation

Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation

Representation Learning with Large Language Models for Recommendation

Leveraging Large Language Models to Enhance Personalized Recommendations in E-commerce

Make Large Language Model a Better Ranker

Large Language Models as Evaluators for Recommendation Explanations

Aligning Large Language Models with Recommendation Knowledge

LLMRG: Improving Recommendations through Large Language Model Reasoning Graphs

Aligning Large Language Model with Direct Multi-Preference Optimization for Recommendation

Empowering Few-Shot Recommender Systems with Large Language Models -- Enhanced Representations

Do LLMs Understand User Preferences? Evaluating LLMs On User Rating Prediction

Empowering Few-Shot Recommender Systems With Large Language Models-Enhanced Representations

A Survey on Large Language Models for Personalized and Explainable Recommendations