Abstract:Existing agents based on large language models (LLMs) demonstrate robust problem-solving capabilities by integrating LLMs' inherent knowledge, strong in-context learning and zero-shot capabilities, and the use of tools combined with intricately designed LLM invocation workflows by humans. However, these agents still exhibit shortcomings in long-term reasoning and under-use the potential of existing tools, leading to noticeable deficiencies in complex real-world reasoning scenarios. To address these limitations, we introduce Sibyl, a simple yet powerful LLM-based agent framework designed to tackle complex reasoning tasks by efficiently leveraging a minimal set of tools. Drawing inspiration from Global Workspace Theory, Sibyl incorporates a global workspace to enhance the management and sharing of knowledge and conversation history throughout the system. Furthermore, guided by Society of Mind Theory, Sibyl implements a multi-agent debate-based jury to self-refine the final answers, ensuring a comprehensive and balanced approach. This approach aims to reduce system complexity while expanding the scope of problems solvable-from matters typically resolved by humans in minutes to those requiring hours or even days, thus facilitating a shift from System-1 to System-2 thinking. Sibyl has been designed with a focus on scalability and ease of debugging by incorporating the concept of reentrancy from functional programming from its inception, with the aim of seamless and low effort integration in other LLM applications to improve capabilities. Our experimental results on the GAIA benchmark test set reveal that the Sibyl agent instantiated with GPT-4 achieves state-of-the-art performance with an average score of 34.55%, compared to other agents based on GPT-4. We hope that Sibyl can inspire more reliable and reusable LLM-based agent solutions to address complex real-world reasoning tasks.

A Learning and Reasoning System for Intelligence Analysis

AI Reasoning Systems: PAC and Applied Methods

When Do Program-of-Thought Works for Reasoning?

AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environment

Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents

DANLI: Deliberative Agent for Following Natural Language Instructions

Leveraging LLM Reasoning Enhances Personalized Recommender Systems

Thinking Assistants: LLM-Based Conversational Assistants that Help Users Think By Asking rather than Answering

Mentigo: An Intelligent Agent for Mentoring Students in the Creative Problem Solving Process

DiscipLink: Unfolding Interdisciplinary Information Seeking Process via Human-AI Co-Exploration

Large Language Models Need Consultants for Reasoning: Becoming an Expert in a Complex Human System Through Behavior Simulation

STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making

An Online Incremental Learning Pattern-Based Reasoning System.

Richelieu: Self-Evolving LLM-Based Agents for AI Diplomacy

TinyThinker: Distilling Reasoning through Coarse-to-Fine Knowledge Internalization with Self-Reflection

Democratizing Reasoning Ability: Tailored Learning from Large Language Model

Hello Again! LLM-powered Personalized Agent for Long-term Dialogue

Sibyl: Simple yet Effective Agent Framework for Complex Real-world Reasoning

ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agent

GraphAide: Advanced Graph-Assisted Query and Reasoning System