LLM Harmony: Multi-Agent Communication for Problem Solving

Sumedh Rasal

2024-01-03

Abstract:Large Language Models (LLMs) have revolutionized Natural Language Processing but exhibit limitations, particularly in autonomously addressing novel challenges such as reasoning and problem-solving. Traditional techniques like chain-of-thought prompting necessitate explicit human guidance. This paper introduces a novel multi-agent communication framework, inspired by the CAMEL model, to enhance LLMs' autonomous problem-solving capabilities. The framework employs multiple LLM agents, each with a distinct persona, engaged in role-playing communication, offering a nuanced and adaptable approach to diverse problem scenarios. Extensive experimentation demonstrates the framework's superior performance and adaptability, providing valuable insights into the collaborative potential of multiple agents in overcoming the limitations of individual models.

Multiagent Systems

What problem does this paper attempt to address?

This paper mainly discusses the limitations of large language models (LLMs) in solving new problems, especially in reasoning and problem-solving. Traditional techniques such as chain-of-thought prompts require explicit human guidance. The author proposes a new multi-agent communication framework, inspired by the CAMEL model, to enhance LLMs' ability to autonomously solve problems. This framework uses multiple LLM agents with different personality traits and adapts to various problem scenarios through role-playing communication.

The paper mentions that although LLMs excel in tasks like text generation and code understanding, they tend to experience information fallacy when dealing with unfamiliar topics and perform poorly in basic reasoning problems. To address these limitations, the framework facilitates collaboration among multiple agents, each with a unique personality, using chain-of-thought prompts to break down complex problems.

Experiments show that this multi-agent framework performs better than individual LLMs and traditional methods in tasks such as mathematical reasoning and common-sense understanding. For example, in mathematical problem-solving experiments on GSM8K and SVAMP datasets, as well as common-sense reasoning experiments on the CSQA dataset, the framework improves the accuracy of problem-solving. Additionally, the paper discusses the limitations of the framework, such as the need for dataset diversity, information update mechanisms, and contextual constraints, and proposes future research directions.

In summary, the paper aims to enhance the problem-solving capabilities of LLMs through multi-agent collaboration, reduce reliance on human guidance, and demonstrates a possible solution to address the limitations of LLMs in handling novel challenges.