Synergistic Multi-Agent Framework with Trajectory Learning for Knowledge-Intensive Tasks

Shengbin Yue,Siyuan Wang,Wei Chen,Xuanjing Huang,Zhongyu Wei

2024-08-26

Abstract:Recent advancements in Large Language Models (LLMs) have led to significant breakthroughs in various natural language processing tasks. However, generating factually consistent responses in knowledge-intensive scenarios remains a challenge due to issues such as hallucination, difficulty in acquiring long-tailed knowledge, and limited memory expansion. This paper introduces SMART, a novel multi-agent framework that leverages external knowledge to enhance the interpretability and factual consistency of LLM-generated responses. SMART comprises four specialized agents, each performing a specific sub-trajectory action to navigate complex knowledge-intensive tasks. We propose a multi-agent co-training paradigm, Long-Short Trajectory Learning, which ensures synergistic collaboration among agents while maintaining fine-grained execution by each agent. Extensive experiments on five knowledge-intensive tasks demonstrate SMART's superior performance compared to widely adopted knowledge internalization and knowledge enhancement methods. Our framework can extend beyond knowledge-intensive tasks to more complex scenarios. Our code is available at <a class="link-external link-https" href="https://github.com/yueshengbin/SMART" rel="external noopener nofollow">this https URL</a>.

Computation and Language

What problem does this paper attempt to address?

This paper attempts to solve the problem of generating fact - consistent responses in knowledge - intensive tasks. Although large - language models (LLMs) internalize a large amount of world knowledge in parameter memory, they still face some challenges in generating fact - consistent responses, such as hallucination, difficulty in accessing long - tail knowledge, and limited ability to expand memory. These problems highlight the necessity of incorporating external knowledge (i.e., retrieval - based memory).

To address these challenges, the authors propose a multi - agent framework named SMART, which utilizes external knowledge to enhance the interpretability and fact - consistency of LLM - generated responses. SMART consists of four specialized agents, each of which performs specific sub - trajectory actions to navigate complex knowledge - intensive tasks. In addition, the paper also proposes a multi - agent collaborative training method - Long - Short Trajectory Learning - to ensure the collaborative cooperation among agents while maintaining the fine - grained execution of each agent.

Extensive experiments on five knowledge - intensive tasks have demonstrated that SMART outperforms widely - adopted knowledge - internalization and knowledge - enhancement methods in performance. This framework is not limited to knowledge - intensive tasks and can be extended to more complex scenarios.