Abstract:In most current research, large language models (LLMs) are able to perform reasoning tasks by generating chains of thought through the guidance of specific prompts. However, there still exists a significant discrepancy between their capability in solving complex reasoning problems and that of humans. At present, most approaches focus on chains of thought (COT) and tool use, without considering the adoption and application of human cognitive frameworks. It is well-known that when confronting complex reasoning challenges, humans typically employ various cognitive abilities, and necessitate interaction with all aspects of tools, knowledge, and the external environment information to accomplish intricate tasks. This paper introduces a novel intelligent framework, referred to as OlaGPT. OlaGPT carefully studied a cognitive architecture framework, and propose to simulate certain aspects of human cognition. The framework involves approximating different cognitive modules, including attention, memory, reasoning, learning, and corresponding scheduling and decision-making mechanisms. Inspired by the active learning mechanism of human beings, it proposes a learning unit to record previous mistakes and expert opinions, and dynamically refer to them to strengthen their ability to solve similar problems. The paper also outlines common effective reasoning frameworks for human problem-solving and designs Chain-of-Thought (COT) templates accordingly. A comprehensive decision-making mechanism is also proposed to maximize model accuracy. The efficacy of OlaGPT has been stringently evaluated on multiple reasoning datasets, and the experimental outcomes reveal that OlaGPT surpasses state-of-the-art benchmarks, demonstrating its superior performance. Our implementation of OlaGPT is available on GitHub: \url{<a class="link-external link-https" href="https://github.com/oladata-team/OlaGPT" rel="external noopener nofollow">this https URL</a>}.

What problem does this paper attempt to address?

The problem this paper attempts to address is the significant gap between large language models (LLMs) and human capabilities in solving complex reasoning problems. Although existing LLMs can complete reasoning tasks by generating chains of thought through specific prompts, they still exhibit notable deficiencies when dealing with complex reasoning problems, mainly in the following aspects: 1. **Generating meaningless or content deviating from human value preferences**: LLMs sometimes produce meaningless content or even give dangerous suggestions. 2. **Knowledge limitations**: The knowledge of LLMs is limited to the concepts and facts explicitly encountered in the training data, making it difficult to truly simulate human intelligence when faced with more complex problems. 3. **Lack of application of human cognitive frameworks**: Existing methods mainly focus on chains of thought (COT) and tool usage, without considering the adoption and application of human cognitive frameworks. To address these issues, the paper introduces a new intelligent framework—OlaGPT. OlaGPT aims to enhance the reasoning capabilities of LLMs by simulating different modules of human cognition (such as attention, memory, reasoning, learning, etc.) and the corresponding scheduling and decision-making mechanisms. Specifically, the main contributions of OlaGPT include: 1. **Systematically enhancing the problem-solving ability of LLMs**: By learning the human cognitive processing framework, improving LLMs' performance in understanding intentions, knowledge accuracy, and reasoning correctness. 2. **Designing various effective reasoning frameworks**: Summarizing human reasoning methods into Chain-of-Thought (COT) templates to maximize the reasoning effect of LLMs in different scenarios. 3. **Innovative active learning and voting mechanisms**: Dynamically referencing historical errors and expert opinions to strengthen LLMs' ability to solve similar problems, and improving the accuracy and robustness of solving complex problems through a voting mechanism. Through these methods, experimental results on multiple reasoning datasets show that OlaGPT outperforms existing benchmark models, demonstrating its superior performance.

OlaGPT: Empowering LLMs With Human-like Problem-Solving Abilities

Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph

LLMs and the Abstraction and Reasoning Corpus: Successes, Failures, and the Importance of Object-based Representations

External Reasoning: Towards Multi-Large-Language-Models Interchangeable Assistance with Human Feedback

HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs

Plan of Thoughts: Heuristic-Guided Problem Solving with Large Language Models

ChatCoT: Tool-Augmented Chain-of-Thought Reasoning on Chat-based Large Language Models

Iteration of Thought: Leveraging Inner Dialogue for Autonomous Large Language Model Reasoning

Thought-Like-Pro: Enhancing Reasoning of Large Language Models through Self-Driven Prolog-based Chain-of-Thought

ChatLogic: Integrating Logic Programming with Large Language Models for Multi-Step Reasoning

A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Models

STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making

How Do Humans Write Code? Large Models Do It the Same Way Too

Art: Automatic multi-step reasoning and tool-use for large language models

Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generation

Textualized Agent-Style Reasoning for Complex Tasks by Multiple Round LLM Generation

Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems

LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models

Oedipus: LLM-enchanced Reasoning CAPTCHA Solver