Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computing

Wenguan Wang,Yi Yang,Fei Wu
2024-10-03
Abstract:Neural-symbolic computing (NeSy), which pursues the integration of the symbolic and statistical paradigms of cognition, has been an active research area of Artificial Intelligence (AI) for many years. As NeSy shows promise of reconciling the advantages of reasoning and interpretability of symbolic representation and robust learning in neural networks, it may serve as a catalyst for the next generation of AI. In the present paper, we provide a systematic overview of the recent developments and important contributions of NeSy research. Firstly, we introduce study history of this area, covering early work and foundations. We further discuss background concepts and identify key driving factors behind the development of NeSy. Afterward, we categorize recent landmark approaches along several main characteristics that underline this research paradigm, including neural-symbolic integration, knowledge representation, knowledge embedding, and functionality. Next, we briefly discuss the successful application of modern NeSy approaches in several domains. Then, we benchmark several NeSy methods on three representative application tasks. Finally, we identify the open problems together with potential future research directions. This survey is expected to help new researchers enter this rapidly evolving field and accelerate the progress towards data-and knowledge-driven AI.
Artificial Intelligence,Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?
The paper aims to address a critical issue in the field of Neural-Symbolic Computing (NeSy), which is how to integrate the two cognitive paradigms of symbolism and connectionism to build the next generation of artificial intelligence systems. Specifically, the paper focuses on the following aspects: 1. **Trustworthiness, Safety, Explainability, and Accountability**: Current AI technologies have significant deficiencies in these areas, especially in decision-critical applications and reasoning-intensive tasks, such as medical diagnosis, autonomous driving, and mathematical reasoning. 2. **Advantages and Disadvantages of Symbolism and Connectionism**: - **Symbolism**: Advantages include requiring fewer input samples, a powerful declarative language for knowledge representation, and conceptually clear internal functions. However, its rule-driven, top-down strategy requires extensive manual tuning and is insensitive to fuzzy and noisy data. - **Connectionism**: Implemented through deep neural networks, advantages include strong fault tolerance, the ability to learn statistical patterns from data, and inductive learning and generalization capabilities. However, it has weak combinatorial generalization ability, low data efficiency, and opaque logic, making its decision-making process difficult to understand. 3. **Potential of Neural-Symbolic Computing**: By combining the reasoning and explainability advantages of symbolism with the robust learning capabilities of connectionism, neural-symbolic computing is expected to become a key driver of the next generation of artificial intelligence. The paper systematically reviews neural-symbolic computing, exploring the historical development, background concepts, key drivers, main research directions, and its applications in various fields. Additionally, the paper benchmarks several neural-symbolic computing methods and points out future research directions, aiming to help new researchers enter this rapidly developing field and accelerate progress towards data and knowledge-driven artificial intelligence.