Abstract:Designing effective prompts can empower LLMs to understand user preferences and provide recommendations by leveraging LLMs' intent comprehension and knowledge utilization capabilities. However, existing research predominantly concentrates on task-wise prompting, developing fixed prompt templates composed of four patterns (i.e., role-playing, history records, reasoning guidance, and output format) and applying them to all users for a given task. Although convenient, task-wise prompting overlooks individual user differences, leading to potential mismatches in capturing user preferences. To address it, we introduce the concept of instance-wise prompting to personalize discrete prompts for individual users and propose Reinforced Prompt Personalization (RPP) to optimize the four patterns in prompts using multi-agent reinforcement learning (MARL). To boost efficiency, RPP formulates prompt personalization as selecting optimal sentences holistically across the four patterns, rather than optimizing word-by-word. To ensure the quality of prompts, RPP meticulously crafts diverse expressions for each of the four patterns, considering multiple analytical perspectives for specific recommendation tasks. In addition to RPP, our proposal of RPP+ aims to enhance the scalability of action space by dynamically refining actions with LLMs throughout the iterative process. We evaluate the effectiveness of RPP/RPP+ in ranking tasks over various datasets. Experimental results demonstrate the superiority of RPP/RPP+ over traditional recommender models, few-shot methods, and other prompt-based methods, underscoring the significance of instance-wise prompting for LLMs in recommendation tasks and validating the effectiveness of RPP/RPP+. Our code is available at <a class="link-external link-https" href="https://github.com/maowenyu-11/RPP" rel="external noopener nofollow">this https URL</a>.

End User Authoring of Personalized Content Classifiers: Comparing Example Labeling, Rule Writing, and LLM Prompting

Prompt Design Matters for Computational Social Science Tasks but in Unpredictable Ways

ReadCtrl: Personalizing text generation with readability-controlled instruction learning

Learning to Rewrite Prompts for Personalized Text Generation

Leveraging Language Models for Emotion and Behavior Analysis in Education

Rethinking ChatGPT's Success: Usability and Cognitive Behaviors Enabled by Auto-regressive LLMs' Prompting

Towards Agile Text Classifiers for Everyone

Prompt Highlighter: Interactive Control for Multi-Modal LLMs

Task Supportive and Personalized Human-Large Language Model Interaction: A User Study

Step-Back Profiling: Distilling User History for Personalized Scientific Writing

Trade-offs in Sampling and Search for Early-stage Interactive Text Classification

LLM Whisperer: An Inconspicuous Attack to Bias LLM Responses

PersonalLLM: Tailoring LLMs to Individual Preferences

Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuning

HELP ME THINK: A Simple Prompting Strategy for Non-experts to Create Customized Content with Models

You Only Prompt Once: On the Capabilities of Prompt Learning on Large Language Models to Tackle Toxic Content

Modeling Collaborator: Enabling Subjective Vision Classification With Minimal Human Effort via LLM Tool-Use

Reinforced Prompt Personalization for Recommendation with Large Language Models

Teach LLMs to Personalize -- An Approach inspired by Writing Education

How Beginning Programmers and Code LLMs (Mis)read Each Other

On Unsupervised Prompt Learning for Classification with Black-box Language Models