Multi-User Chat Assistant (MUCA): a Framework Using LLMs to Facilitate Group Conversations

Manqing Mao,Paishun Ting,Yijian Xiang,Mingyang Xu,Julia Chen,Jianzhe Lin

2024-10-05

Abstract:Recent advancements in large language models (LLMs) have provided a new avenue for chatbot development. Most existing research, however, has primarily centered on single-user chatbots that determine "What" to answer. This paper highlights the complexity of multi-user chatbots, introducing the 3W design dimensions: "What" to say, "When" to respond, and "Who" to answer. Additionally, we proposed Multi-User Chat Assistant (MUCA), an LLM-based framework tailored for group discussions. MUCA consists of three main modules: Sub-topic Generator, Dialog Analyzer, and Conversational Strategies Arbitrator. These modules jointly determine suitable response contents, timings, and appropriate addressees. This paper further proposes an LLM-based Multi-User Simulator (MUS) to ease MUCA's optimization, enabling faster simulation of conversations between the chatbot and simulated users, and speeding up MUCA's early development. In goal-oriented conversations with a small to medium number of participants, MUCA demonstrates effectiveness in tasks like chiming in at appropriate timings, generating relevant content, and improving user engagement, as shown by case studies and user studies.

Computation and Language

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to construct an effective multi - user chat assistant (MUCA) through large - language models (LLMs) in multi - user chat scenarios. Different from traditional single - user chatbots, multi - user chatbots need to handle more complex interaction environments, including but not limited to:

1. **Content intelligence ("What")**: Determine the content that the chatbot should respond to. In multi - user scenarios, this involves meeting the complex needs of multiple users such as resolving conflicts and managing multi - threaded discussions.
2. **Timing intelligence ("When")**: Determine when the chatbot should respond or remain silent. In multi - user chats, timely intervention can promote the smooth progress of the conversation and avoid unnecessary interference.
3. **Object intelligence ("Who")**: Determine the response target of the chatbot, which can be a specific user group, unspecified participants, or all participants. In a multi - user environment, correctly choosing the response target is crucial for maintaining the coherence and participation of the conversation.

The paper proposes a framework MUCA based on LLMs, aiming to solve the design challenges in the above three dimensions and achieve this goal through three main modules - sub - topic generator, conversation analyzer, and conversation policy arbiter. In addition, in order to accelerate the optimization process of MUCA, the paper also proposes a multi - user simulator (MUS) based on LLMs, which is used to simulate the conversation between the chatbot and virtual users, thereby speeding up the early development process.

The design of MUCA aims to improve user participation, conversation balance, conflict resolution ability, and the timeliness and relevance of conversations in multi - user chats. Through case studies and user studies, the paper demonstrates the effectiveness of MUCA in small - to - medium - sized group goal - oriented conversation tasks, such as opinion reaching, problem solving, and open discussion.