Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agents

Haoyi Xiong,Zhiyuan Wang,Xuhong Li,Jiang Bian,Zeke Xie,Shahid Mumtaz,Anwer Al-Dulaimi,Laura E. Barnes
2024-10-15
Abstract:This article explores the convergence of connectionist and symbolic artificial intelligence (AI), from historical debates to contemporary advancements. Traditionally considered distinct paradigms, connectionist AI focuses on neural networks, while symbolic AI emphasizes symbolic representation and logic. Recent advancements in large language models (LLMs), exemplified by ChatGPT and GPT-4, highlight the potential of connectionist architectures in handling human language as a form of symbols. The study argues that LLM-empowered Autonomous Agents (LAAs) embody this paradigm convergence. By utilizing LLMs for text-based knowledge modeling and representation, LAAs integrate neuro-symbolic AI principles, showcasing enhanced reasoning and decision-making capabilities. Comparing LAAs with Knowledge Graphs within the neuro-symbolic AI theme highlights the unique strengths of LAAs in mimicking human-like reasoning processes, scaling effectively with large datasets, and leveraging in-context samples without explicit re-training. The research underscores promising avenues in neuro-vector-symbolic integration, instructional encoding, and implicit reasoning, aimed at further enhancing LAA capabilities. By exploring the progression of neuro-symbolic AI and proposing future research trajectories, this work advances the understanding and development of AI technologies.
Artificial Intelligence
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper explores the integration of connectionist and symbolic artificial intelligence (AI), from historical debates to modern progress. Specifically, the paper aims to solve the following problems: 1. **Historical Background and Technological Evolution**: - **Historical Debates between Connectionism and Symbolism**: The paper reviews the historical debates between the two AI paradigms of connectionism and symbolism, and explains their respective strengths and limitations. - **Development of Modern Technologies**: The paper introduces the latest progress in large - language models (LLMs) and foundation models, which have shown unprecedented capabilities in natural - language understanding and generation. 2. **Integration of Paradigms**: - **LLM - Empowered Autonomous Agents (LAAs)**: The paper discusses how to develop LLM - empowered autonomous agents (LAAs) by combining symbolic and connectionist methods. LAAs use LLMs for text - knowledge modeling and representation, while integrating neuro - symbolic AI principles, demonstrating enhanced reasoning and decision - making capabilities. - **Comparison with Knowledge Graphs (KGs)**: The paper compares LAAs with knowledge graphs (KGs), emphasizing the unique advantages of LAAs in simulating human reasoning processes, handling large - scale data sets, and utilizing context samples. 3. **Future Directions**: - **Neuro - Vector - Symbolic Architectures**: The paper proposes the development direction of neuro - vector - symbolic architectures, enhancing the reasoning capabilities of agents by integrating vector operations. - **Program - Proof - of - Thoughts (P2oT)**: The paper introduces a method called program - proof - of - thoughts (P2oT), which decomposes complex reasoning processes into verifiable propositions and uses a program - proof language (such as Dafny) for structured verification to provide strict reasoning. ### Summary By reviewing the historical debates between connectionism and symbolism, the paper explores the development of modern technologies, especially the rise of LLMs and LAAs. It emphasizes the importance of LAAs in integrating symbolic and connectionist methods and proposes directions for future research, aiming to further enhance the capabilities and application potential of AI technologies.