Abstract:In the past decades, recommender systems have attracted much attention in both research and industry communities, and a large number of studies have been devoted to developing effective recommendation models. Basically speaking, these models mainly learn the underlying user preference from historical behavior data, and then estimate the user-item matching relationships for recommendations. Inspired by the recent progress on large language models (LLMs), we take a different approach to developing the recommendation models, considering recommendation as instruction following by LLMs. The key idea is that the preferences or needs of a user can be expressed in natural language descriptions (called instructions), so that LLMs can understand and further execute the instruction for fulfilling the recommendation task. Instead of using public APIs of LLMs, we instruction tune an open-source LLM (3B Flan-T5-XL), in order to better adapt LLMs to recommender systems. For this purpose, we first design a general instruction format for describing the preference, intention, task form and context of a user in natural language. Then we manually design 39 instruction templates and automatically generate a large amount of user-personalized instruction data (252K instructions) with varying types of preferences and intentions. To demonstrate the effectiveness of our approach, we instantiate the instruction templates into several widely-studied recommendation (or search) tasks, and conduct extensive experiments on these tasks with real-world datasets. Experiment results show that the proposed approach can outperform several competitive baselines, including the powerful GPT-3.5, on these evaluation tasks. Our approach sheds light on developing more user-friendly recommender systems, in which users can freely communicate with the system and obtain more accurate recommendations via natural language instructions.

Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models

Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models

InstructZero: Efficient Instruction Optimization for Black-Box Large Language Models

BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing

Instruction Distillation Makes Large Language Models Efficient Zero-shot Rankers

Automatic Instruction Evolving for Large Language Models

Find the Intention of Instruction: Comprehensive Evaluation of Instruction Understanding for Large Language Models

SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning

Evaluating Large Language Models at Evaluating Instruction Following

WizardLM: Empowering Large Pre-Trained Language Models to Follow Complex Instructions

Instruction Mining: Instruction Data Selection for Tuning Large Language Models

AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learning

Instruction Position Matters in Sequence Generation with Large Language Models

Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach

LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement

EasyInstruct: An Easy-to-use Instruction Processing Framework for Large Language Models

Demystifying Instruction Mixing for Fine-tuning Large Language Models

CoachLM: Automatic Instruction Revisions Improve the Data Quality in LLM Instruction Tuning

Evaluating the Zero-shot Robustness of Instruction-tuned Language Models

Raw Text is All you Need: Knowledge-intensive Multi-turn Instruction Tuning for Large Language Model

AutoMMLab: Automatically Generating Deployable Models from Language Instructions for Computer Vision Tasks