Abstract:Large Language Models (LLMs) have achieved remarkable success in various fields, prompting several studies to explore their potential in recommendation systems. However, these attempts have so far resulted in only modest improvements over traditional recommendation models. Moreover, three critical questions remain under-explored: firstly, the real value of LLMs' pre-trained weights, often considered to encapsulate world knowledge; secondly, the necessity of fine-tuning for recommendation tasks; lastly, whether LLMs can exhibit the same scalability benefits in recommendation systems as they do in other domains. In this paper, we propose a novel Hierarchical Large Language Model (HLLM) architecture designed to enhance sequential recommendation systems. Our approach employs a two-tier model: the first Item LLM extracts rich content features from the detailed text description of the item, while the second User LLM utilizes these features to predict users' future interests based on their interaction history. Extensive experiments demonstrate that our method effectively leverages the pre-trained capabilities of open-source LLMs, and further fine-tuning leads to significant performance boosts. Additionally, HLLM achieves excellent scalability, with the largest configuration utilizing 7B parameters for both item feature extraction and user interest modeling. Moreover, HLLM offers excellent training and serving efficiency, making it practical in real-world applications. Evaluations on two large-scale datasets, PixelRec and Amazon Reviews, show that HLLM achieves state-of-the-art results, outperforming traditional ID-based models by a wide margin. In online A/B testing, HLLM showcases notable gains, validating its practical impact in real-world recommendation scenarios. Codes are available at <a class="link-external link-https" href="https://github.com/bytedance/HLLM" rel="external noopener nofollow">this https URL</a>.

Logical Relation Modeling and Mining in Hyperbolic Space for Recommendation

Improved Metric-Based Recommender by Historical Interactions.

Enhancing Recommendation with Automated Tag Taxonomy Construction in Hyperbolic Space

Illuminating Recommendation by Understanding the Explicit Item Relations

Towards High-Order Complementary Recommendation via Logical Reasoning Network

Modelling High-Order Social Relations for Item Recommendation (extended Abstract)

LLMRG: Improving Recommendations through Large Language Model Reasoning Graphs

Enhancing Recommender Systems with Large Language Model Reasoning Graphs

Automatic Hypergraph Generation for Enhancing Recommendation with Sparse Optimization

Hybrid Recommendation Algorithm Based On Two Roles Of Social Tags

Hyperbolic Translation-Based Sequential Recommendation

Sequential Recommendation with Latent Relations based on Large Language Model

Capturing Semantic Correlation for Item Recommendation in Tagging Systems

Tackling Data Sparseness in Recommendation Using Social Media Based Topic Hierarchy Modeling.

Hierarchical User Intention-Preference for Sequential Recommendation with Relation-Aware Heterogeneous Information Network Embedding

A Hyperbolic-to-Hyperbolic User Representation with Multi-aspect for Social Recommendation

HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modeling

Multi-relational Topic Model for Social Recommendation

LLM-Guided Multi-View Hypergraph Learning for Human-Centric Explainable Recommendation

Neuro-symbolic recommendation model based on logic query

Hyperbolic Personalized Tag Recommendation