Abstract:Large Language Models (LLMs) have demonstrated remarkable capabilities in solving various tasks, yet they often struggle with comprehensively addressing complex and vague problems. Existing approaches, including multi-agent LLM systems, offer solutions to certain challenges but still require manual setup and lack scalability. To address this gap, we propose a novel approach leveraging decomposition to enable LLMs to tackle vague problems effectively. Our approach involves an orchestrating LLM that interacts with users to understand the problem and then decomposes it into tangible sub-problems. Instead of expecting the LLM to solve the entire problem in one go, we train it to ask follow-up questions to gain a deeper understanding of the user's requirements. Once the problem is adequately understood, the orchestrating LLM divides it into smaller, manageable sub-problems. Each sub-problem is then assigned to specialized LLM agents or non-LLM functions for resolution. These agents work in parallel to solve their respective sub-problems, with the orchestrating LLM overseeing the process and compiling the solutions into a comprehensive answer for the user. By adopting this decomposition approach, we alleviate the constraints imposed by token limitations on LLM outputs and empower them to provide nuanced solutions to complex and ambiguous problems. Through our approach, we aim to enable LLMs to think and operate more like humans, breaking down complex problems into manageable parts and collaboratively solving them. This not only enhances the problem-solving capabilities of LLMs but also offers a scalable and efficient method for addressing a wide range of real-world challenges.

Merging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Powered Autonomous Agents

Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agents

Synergistic Integration of Large Language Models and Cognitive Architectures for Robust AI: An Exploratory Analysis

LLM Harmony: Multi-Agent Communication for Problem Solving

Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents

Exploring Autonomous Agents through the Lens of Large Language Models: A Review

Two Heads Are Better Than One: Collaborative LLM Embodied Agents for Human-Robot Interaction

Can LLM-Augmented autonomous agents cooperate?, An evaluation of their cooperative capabilities through Melting Pot

Practical Considerations for Agentic LLM Systems

Integration of Large Language Models within Cognitive Architectures for Autonomous Robots

On the Prospects of Incorporating Large Language Models (LLMs) in Automated Planning and Scheduling (APS)

Neurosymbolic AI approach to Attribution in Large Language Models

Synergizing Machine Learning & Symbolic Methods: A Survey on Hybrid Approaches to Natural Language Processing

Large Language Models Are Neurosymbolic Reasoners

Synergistic Simulations: Multi-Agent Problem Solving with Large Language Models

A Language Agent for Autonomous Driving

An In-depth Survey of Large Language Model-based Artificial Intelligence Agents

Cognitive Architectures for Language Agents

Navigating Complexity: Orchestrated Problem Solving with Multi-Agent LLMs

Effective Integration of Symbolic and Connectionist Approaches through a Hybrid Representation