RAH! RecSys-Assistant-Human: A Human-Centered Recommendation Framework with LLM Agents

Yubo Shu,Haonan Zhang,Hansu Gu,Peng Zhang,Tun Lu,Dongsheng Li,Ning Gu

2023-10-17

Abstract:The rapid evolution of the web has led to an exponential growth in content. Recommender systems play a crucial role in Human-Computer Interaction (HCI) by tailoring content based on individual preferences. Despite their importance, challenges persist in balancing recommendation accuracy with user satisfaction, addressing biases while preserving user privacy, and solving cold-start problems in cross-domain situations. This research argues that addressing these issues is not solely the recommender systems' responsibility, and a human-centered approach is vital. We introduce the RAH Recommender system, Assistant, and Human) framework, an innovative solution with LLM-based agents such as Perceive, Learn, Act, Critic, and Reflect, emphasizing the alignment with user personalities. The framework utilizes the Learn-Act-Critic loop and a reflection mechanism for improving user alignment. Using the real-world data, our experiments demonstrate the RAH framework's efficacy in various recommendation domains, from reducing human burden to mitigating biases and enhancing user control. Notably, our contributions provide a human-centered recommendation framework that partners effectively with various recommendation models.

Information Retrieval,Artificial Intelligence

What problem does this paper attempt to address?

The paper aims to address some core challenges in recommender systems, including finding a balance between recommendation accuracy and user satisfaction, handling recommendation bias, protecting user privacy, and solving the cold start problem in cross-domain scenarios. The authors believe that these issues cannot be resolved solely by improving the recommender system itself but also require a more human-centric approach from the user's perspective. To this end, the paper proposes a framework called RAH (Recommender system, Assistant, and Human), which combines agents driven by large language models (LLM) to better understand and adapt to user personalities. These agents include the Perceive Agent, Learn Agent, Act Agent, Critic Agent, and Reflect Agent. Through the collaboration among these agents, especially via the Learn-Act-Critic loop and reflection mechanism, the RAH framework can reduce user burden, mitigate recommendation bias, and enhance user control over the recommendation results. The experimental section demonstrates the effectiveness of the RAH framework in various recommendation domains, including reducing the number of user interactions, alleviating bias, and improving user control over the recommender system. Tests on real datasets validate the potential of this framework in addressing the challenges faced by recommender systems.

RAH! RecSys-Assistant-Human: A Human-Centered Recommendation Framework with LLM Agents

SUBER: An RL Environment with Simulated Human Behavior for Recommender Systems

RA-Rec: An Efficient ID Representation Alignment Framework for LLM-based Recommendation

Digital Human Interactive Recommendation Decision-Making Based on Reinforcement Learning

Negotiating the Shared Agency between Humans & AI in the Recommender System

RECENT ADVANCES IN PERSONAL RECOMMENDER SYSTEMS

Leveraging LLM Reasoning Enhances Personalized Recommender Systems

Human-Centered Recommender Systems: Origins, Advances, Challenges, and Opportunities

DRL-HIFA: a dynamic recommendation system with deep reinforcement learning based Hidden Markov Weight Updation and factor analysis

A LLM-based Controllable, Scalable, Human-Involved User Simulator Framework for Conversational Recommender Systems

All Roads Lead to Rome: Unveiling the Trajectory of Recommender Systems Across the LLM Era

Behavior Alignment: A New Perspective of Evaluating LLM-based Conversational Recommender Systems

Recommender systems enhancement using deep reinforcement learning

Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems

Reinforcement Learning for Strategic Recommendations

AdaRec: Adaptive Sequential Recommendation for Reinforcing Long-term User Engagement

The 1st Workshop on Human-Centered Recommender Systems

LLaRA: Large Language-Recommendation Assistant

On Generative Agents in Recommendation

HARec: Hyperbolic Graph-LLM Alignment for Exploration and Exploitation in Recommender Systems

Deep Reinforcement Learning based Recommendation with Explicit User-Item Interactions Modeling