Abstract:The development of artificial intelligence systems with advanced reasoning capabilities represents a persistent and long-standing research question. Traditionally, the primary strategy to address this challenge involved the adoption of symbolic approaches, where knowledge was explicitly represented by means of symbols and explicitly programmed rules. However, with the advent of machine learning, there has been a paradigm shift towards systems that can autonomously learn from data, requiring minimal human guidance. In light of this shift, in latest years, there has been increasing interest and efforts at endowing neural networks with the ability to reason, bridging the gap between data-driven learning and logical reasoning. Within this context, Neural Algorithmic Reasoning (NAR) stands out as a promising research field, aiming to integrate the structured and rule-based reasoning of algorithms with the adaptive learning capabilities of neural networks, typically by tasking neural models to mimic classical algorithms. In this dissertation, we provide theoretical and practical contributions to this area of research. We explore the connections between neural networks and tropical algebra, deriving powerful architectures that are aligned with algorithm execution. Furthermore, we discuss and show the ability of such neural reasoners to learn and manipulate complex algorithmic and combinatorial optimization concepts, such as the principle of strong duality. Finally, in our empirical efforts, we validate the real-world utility of NAR networks across different practical scenarios. This includes tasks as diverse as planning problems, large-scale edge classification tasks and the learning of polynomial-time approximate algorithms for NP-hard combinatorial problems. Through this exploration, we aim to showcase the potential integrating algorithmic reasoning in machine learning models.

DYNAMIC REASONING NET TO SUPPORT PARALLEL REASONING IN PRODUCTION SYSTEM

Product Knowledge Reasoning

Towards Neural Network-based Reasoning

DyRRen: A Dynamic Retriever-Reranker-Generator Model for Numerical Reasoning over Tabular and Textual Data.

Learning Visual Abstract Reasoning through Dual-Stream Networks

Rete Algorithm:Current Issues and Future Challenge

Neural Axiom Network for Knowledge Graph Reasoning

ScudCORE :A Context-Driven Reasoning Engine

TGR: Neural-symbolic ontological reasoner for domain-specific knowledge graphs

Reasoning Algorithmically in Graph Neural Networks

Neural, symbolic and neural-symbolic reasoning on knowledge graphs

Neural Logic Reasoning

Abstract Spatial-Temporal Reasoning Via Probabilistic Abduction and Execution

A reasoning algorithm for high-level fuzzy Petri nets

CapableOf Reasoning: A Step Towards Commonsense Oracle

Enhancing Numerical Reasoning with the Guidance of Reliable Reasoning Processes

Reasoning in artificial intelligence:advances and challenges

Learning Algebraic Representation for Systematic Generalization in Abstract Reasoning

A stacked graph neural network with self-exciting process for robotic cognitive strategy reasoning in proactive human-robot collaborative assembly

On the Markov Property of Neural Algorithmic Reasoning: Analyses and Methods

NELLIE: A Neuro-Symbolic Inference Engine for Grounded, Compositional, and Explainable Reasoning