Abstract:With the advancement of large language models (LLMs), researchers have explored various methods to optimally leverage their comprehension and generation capabilities in sequential recommendation scenarios. However, several challenges persist in this endeavor. Firstly, most existing approaches rely on the input-output prompting paradigm, which can result in irrelevant or inaccurate responses. Secondly, while there have been attempts to enhance LLMs using prompting strategies such as chain-of-thought (CoT), these efforts have not fully harnessed the reasoning abilities of LLMs or effectively captured the multifaceted information contained within user sequences. To address these limitations, we propose GOT4Rec, a sequential recommendation method that utilizes the graph of thoughts (GoT) prompting strategy. Specifically, we identify and utilize three key types of information within user history sequences: short-term interests, long-term interests and collaborative information from other users. Our approach enables LLMs to independently reason and generate recommendations based on these distinct types of information, subsequently aggregating the results within the GoT framework to derive the final recommended items. This method allows LLMs, with enhanced reasoning capabilities, to more effectively consider the diverse information within user sequences, resulting in more accurate recommendations and more comprehensive explanations. Extensive experiments on real-world datasets demonstrate the effectiveness of GOT4Rec, indicating that it outperforms existing state-of-the-art baselines. Our code is available at <a class="link-external link-https" href="https://anonymous.4open.science/r/GOT4Rec-ED99" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

This paper attempts to solve two main problems faced when using large language models (LLMs) in sequential recommendation: 1. **Difficulty in Clearly Capturing User Preference Information**: - Most of the existing methods rely on the input - output (IO) prompting paradigm, which is prone to causing irrelevant or inaccurate responses. Traditional neural sequential recommendation systems predict the next item in the sequence by extracting and fusing different types of features, while existing LLM - based sequential recommendation systems usually perform minimal processing on the sequence itself and directly put the entire sequence into the prompt, which may mislead the model and thus generate inaccurate recommendations. 2. **Complex Multi - Information Fusion Task**: - Integrating multiple types of information (such as short - term interests, long - term interests, spatio - temporal factors, etc.) into sequential recommendation makes this task complex and requires an LLM with enhanced reasoning ability. Existing simple reasoning methods (such as IO and CoT) cannot effectively deal with these complex tasks. Specifically, existing methods fail to fully utilize the reasoning ability of the LLM and cannot fully capture the diverse preference information in the user behavior sequence. To solve these problems, the authors propose the GOT4Rec method, which introduces the "Graph of Thoughts" (GoT) framework to better utilize the reasoning ability of the LLM and effectively integrate multiple information sources from user sequences. Specifically, GOT4Rec solves the above problems in the following ways: - **Decomposing Complex Reasoning Tasks**: The GoT method decomposes complex reasoning tasks into smaller, more manageable subtasks, then solves these subtasks separately and integrates the results to form a comprehensive solution. - **Capturing Different Types of Information**: GOT4Rec identifies and utilizes three key pieces of information from the user's historical sequence: short - term interests, long - term interests, and collaborative information from other users. This method enables the LLM to reason independently and generate recommendations based on these different pieces of information, and finally aggregates the results within the GoT framework to obtain the final recommended items. In this way, GOT4Rec not only enhances the reasoning ability of the LLM but also more effectively considers the diverse information in the user sequence, thereby improving the accuracy and interpretability of recommendations. Experimental results show that GOT4Rec outperforms existing state - of - the - art baseline methods on multiple real - world datasets.

GOT4Rec: Graph of Thoughts for Sequential Recommendation

GPT4Rec: Graph Prompt Tuning for Streaming Recommendation

GAT4Rec: Sequential Recommendation with a Gated Recurrent Unit and Transformers

DRDT: Dynamic Reflection with Divergent Thinking for LLM-based Sequential Recommendation

ELCoRec: Enhance Language Understanding with Co-Propagation of Numerical and Categorical Features for Recommendation

LLMRG: Improving Recommendations through Large Language Model Reasoning Graphs

APGL4SR: A Generic Framework with Adaptive and Personalized Global Collaborative Information in Sequential Recommendation

Enhancing Recommender Systems with Large Language Model Reasoning Graphs

On Generative Agents in Recommendation

Graph of Thoughts: Solving Elaborate Problems with Large Language Models

Improve Temporal Awareness of LLMs for Sequential Recommendation

GPT4Rec: A Generative Framework for Personalized Recommendation and User Interests Interpretation

RecMind: Large Language Model Powered Agent For Recommendation

Graph-Augmented Co-Attention Model for Socio-Sequential Recommendation

Graph Neural Network-Guided Contrastive Learning for Sequential Recommendation

A Bi-Step Grounding Paradigm for Large Language Models in Recommendation Systems

Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Models

Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs

DGoT: Dynamic Graph of Thoughts for Scientific Abstract Generation

LLMRec: Large Language Models with Graph Augmentation for Recommendation