Abstract:Memory is identified as a crucial human faculty that allows for the retention of visual and linguistic information within the hippocampus and neurons in the brain, which can subsequently be retrieved to address real-world challenges that arise through a lifetime of learning. The resolution of complex AI tasks through the application of acquired knowledge represents a stride toward the realization of artificial general intelligence. However, despite the prevalence of Large Language Models (LLMs) like GPT-3.5 and GPT-4 \cite{brown2020language, leiter2023chatgpt, zaitsu2023distinguishing, OpenAI2023GPT4TR} , which have displayed remarkable capabilities in language comprehension, generation, interaction, and reasoning, they are inhibited by constraints on context length that preclude the processing of extensive, continually evolving knowledge bases. This paper proposes that LLMs could be augmented through the selective integration of knowledge from external repositories, and in doing so, introduces a novel methodology for External Reasoning, exemplified by ChatPDF. Central to this approach is the establishment of a tiered policy for \textbf{External Reasoning based on Multiple LLM Interchange Assistance} in \cref{fig:overall}, where the level of support rendered is modulated across entry, intermediate, and advanced tiers based on the complexity of the query, with adjustments made in response to human feedback. A comprehensive evaluation of this methodology is conducted using multiple LLMs and the results indicate state-of-the-art performance in \cref{comparison} , surpassing existing solutions including <a class="link-external link-http" href="http://ChatPDF.com" rel="external noopener nofollow">this http URL</a>. Moreover, the paper emphasizes that this approach is more efficient compared to the direct processing of full text by LLMs. The source code is publicly available at: \url{<a class="link-external link-https" href="https://github.com/AkideLiu/ANLP" rel="external noopener nofollow">this https URL</a>}.

ChatLogic: Integrating Logic Programming with Large Language Models for Multi-Step Reasoning

Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text

ChatCoT: Tool-Augmented Chain-of-Thought Reasoning on Chat-based Large Language Models

ChatABL: Abductive Learning via Natural Language Interaction with ChatGPT

External Reasoning: Towards Multi-Large-Language-Models Interchangeable Assistance with Human Feedback

LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models

Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning

Logic Query of Thoughts: Guiding Large Language Models to Answer Complex Logic Queries with Knowledge Graphs

Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models

Can Language Models Pretend Solvers? Logic Code Simulation with LLMs

Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs

LogicPro: Improving Complex Logical Reasoning via Program-Guided Learning

Learning to Program with Natural Language

ChatLLM Network: More brains, More intelligence

Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debate

Reasoning in Conversation: Solving Subjective Tasks through Dialogue Simulation for Large Language Models

ChatRule: Mining Logical Rules with Large Language Models for Knowledge Graph Reasoning

ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory

LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models

GLoRE: Evaluating Logical Reasoning of Large Language Models