Abstract:Is intelligence realized by connectionist or classicist? While connectionist approaches have achieved superhuman performance, there has been growing evidence that such task-specific superiority is particularly fragile in systematic generalization. This observation lies in the central debate (Fodor et al., 1988; Fodor &McLaughlin, 1990) between connectionist and classicist, wherein the latter continually advocates an algebraic treatment in cognitive architectures. In this work, we follow the classicist's call and propose a hybrid approach to improve systematic generalization in reasoning. Specifically, we showcase a prototype with algebraic representations for the abstract spatial-temporal reasoning task of Raven’s Progressive Matrices (RPM) and present the ALgebra-Aware Neuro-Semi-Symbolic (ALANS2) learner. The ALANS2 learner is motivated by abstract algebra and the representation theory. It consists of a neural visual perception frontend and an algebraic abstract reasoning backend: the frontend summarizes the visual information from object-based representations, while the backend transforms it into an algebraic structure and induces the hidden operator on-the-fly. The induced operator is later executed to predict the answer's representation, and the choice most similar to the prediction is selected as the solution. Extensive experiments show that by incorporating an algebraic treatment, the ALANS2 learner outperforms various pure connectionist models in domains requiring systematic generalization. We further show that the algebraic representation learned can be decoded by isomorphism and used to generate an answer.

Enhancing Neural Mathematical Reasoning by Abductive Combination with Symbolic Library

Learning Algebraic Representation for Systematic Generalization in Abstract Reasoning

Specialized Mathematical Solving by a Step-By-Step Expression Chain Generation

Abductive Symbolic Solver on Abstraction and Reasoning Corpus

Transformers discover an elementary calculation system exploiting local attention and grid-like problem representation

Learning Algebraic Representation for Abstract Spatial-Temporal Reasoning

Bridging Logic and Learning: A Neural-Symbolic Approach for Enhanced Reasoning in Neural Models (ASPER)

Meta-Reasoning: Semantics-Symbol Deconstruction for Large Language Models

Tunneling Neural Perception and Logic Reasoning through Abductive Learning

Efficient Rectification of Neuro-Symbolic Reasoning Inconsistencies by Abductive Reflection

LEMMA: Bootstrapping High-Level Mathematical Reasoning with Learned Symbolic Abstractions

Reasoning in Large Language Models Through Symbolic Math Word Problems

Neuro-Symbolic Data Generation for Math Reasoning

A Neural-Guided Dynamic Symbolic Network for Exploring Mathematical Expressions from Data

Analysing Mathematical Reasoning Abilities of Neural Models

Improved Logical Reasoning of Language Models via Differentiable Symbolic Programming

Analysis for Abductive Learning and Neural-Symbolic Reasoning Shortcuts

A Survey of Deep Learning for Mathematical Reasoning

Bridging Machine Learning and Logical Reasoning by Abductive Learning.

Multi-tool Integration Application for Math Reasoning Using Large Language Model