Abstract:In most current research, large language models (LLMs) are able to perform reasoning tasks by generating chains of thought through the guidance of specific prompts. However, there still exists a significant discrepancy between their capability in solving complex reasoning problems and that of humans. At present, most approaches focus on chains of thought (COT) and tool use, without considering the adoption and application of human cognitive frameworks. It is well-known that when confronting complex reasoning challenges, humans typically employ various cognitive abilities, and necessitate interaction with all aspects of tools, knowledge, and the external environment information to accomplish intricate tasks. This paper introduces a novel intelligent framework, referred to as OlaGPT. OlaGPT carefully studied a cognitive architecture framework, and propose to simulate certain aspects of human cognition. The framework involves approximating different cognitive modules, including attention, memory, reasoning, learning, and corresponding scheduling and decision-making mechanisms. Inspired by the active learning mechanism of human beings, it proposes a learning unit to record previous mistakes and expert opinions, and dynamically refer to them to strengthen their ability to solve similar problems. The paper also outlines common effective reasoning frameworks for human problem-solving and designs Chain-of-Thought (COT) templates accordingly. A comprehensive decision-making mechanism is also proposed to maximize model accuracy. The efficacy of OlaGPT has been stringently evaluated on multiple reasoning datasets, and the experimental outcomes reveal that OlaGPT surpasses state-of-the-art benchmarks, demonstrating its superior performance. Our implementation of OlaGPT is available on GitHub: \url{<a class="link-external link-https" href="https://github.com/oladata-team/OlaGPT" rel="external noopener nofollow">this https URL</a>}.

HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs

A Preliminary Study of o1 in Medicine: Are We Closer to an AI Doctor?

OlaGPT: Empowering LLMs With Human-like Problem-Solving Abilities

Reasoning with large language models for medical question answering

A Comparative Study on Reasoning Patterns of OpenAI's o1 Model

Can large language models reason about medical questions?

From Beginner to Expert: Modeling Medical Knowledge into General LLMs

Improving LLM Reasoning through Scaling Inference Computation with Collaborative Verification

MedG-KRP: Medical Graph Knowledge Representation Probing

Guiding Clinical Reasoning with Large Language Models via Knowledge Seeds

Can LLMs Reason in the Wild with Programs?

Can We Further Elicit Reasoning in LLMs? Critic-Guided Planning with Retrieval-Augmentation for Solving Challenging Tasks

Plan of Thoughts: Heuristic-Guided Problem Solving with Large Language Models

OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models

Competition-Level Problems are Effective LLM Evaluators

Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios

LogicPro: Improving Complex Logical Reasoning via Program-Guided Learning

LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models

Are Your LLMs Capable of Stable Reasoning?

Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification