Abstract:The integration of reasoning, learning, and decision-making is key to build more general artificial intelligence systems. As a step in this direction, we propose a novel neural-logic architecture, called differentiable logic machine (DLM), that can solve both inductive logic programming (ILP) and reinforcement learning (RL) problems, where the solution can be interpreted as a first-order logic program. Our proposition includes several innovations. Firstly, our architecture defines a restricted but expressive continuous relaxation of the space of first-order logic programs by assigning weights to predicates instead of rules, in contrast to most previous neural-logic approaches. Secondly, with this differentiable architecture, we propose several (supervised and RL) training procedures, based on gradient descent, which can recover a fully-interpretable solution (i.e., logic formula). Thirdly, to accelerate RL training, we also design a novel critic architecture that enables actor-critic algorithms. Fourthly, to solve hard problems, we propose an incremental training procedure that can learn a logic program progressively. Compared to state-of-the-art (SOTA) differentiable ILP methods, DLM successfully solves all the considered ILP problems with a higher percentage of successful seeds (up to 3.5$\times$). On RL problems, without requiring an interpretable solution, DLM outperforms other non-interpretable neural-logic RL approaches in terms of rewards (up to 3.9%). When enforcing interpretability, DLM can solve harder RL problems (e.g., Sorting, Path) Moreover, we show that deep logic programs can be learned via incremental supervised training. In addition to this excellent performance, DLM can scale well in terms of memory and computational time, especially during the testing phase where it can deal with much more constants ($>$2$\times$) than SOTA.

Differentiable Logic Programming for Probabilistic Reasoning

Differentiable Learning of Logical Rules for Knowledge Base Reasoning

Differentiable Inductive Logic Programming for Structured Examples

Learning First-Order Rules with Differentiable Logic Program Semantics

A Differentiable First-Order Rule Learner for Inductive Logic Programming

Learning Probabilistic Logic Programs in Continuous Domains

Differentiable Logic Machines

Declarative Probabilistic Logic Programming in Discrete-Continuous Domains

Differentiable Inductive Logic Programming in High-Dimensional Space

Inductive Logic Boosting

Learning from Interpretation Transition Using Differentiable Logic Programming Semantics

Beyond Logic Programming for Legal Reasoning

dPASP: A Comprehensive Differentiable Probabilistic Answer Set Programming Environment For Neurosymbolic Learning and Reasoning

Differentiable Logic Programming for Distant Supervision

A History of Probabilistic Inductive Logic Programming

A Survey on Inductive Logic Programming

Deep Inductive Logic Programming meets Reinforcement Learning

First-Order Context-Specific Likelihood Weighting in Hybrid Probabilistic Logic Programs

Neural Probabilistic Logic Programming in Discrete-Continuous Domains

Learning differentiable logic programs for abstract visual reasoning