Abstract:Despite the practical success of Artificial Intelligence (AI), current neural AI algorithms face two significant issues. First, the decisions made by neural architectures are often prone to bias and brittleness. Second, when a chain of reasoning is required, neural systems often perform poorly. Neuro-symbolic artificial intelligence is a promising approach that tackles these (and other) weaknesses by combining the power of neural perception and symbolic reasoning. Meanwhile, the success of AI has made it critical to understand its behaviour, leading to the development of explainable artificial intelligence (XAI). While neuro-symbolic AI systems have important advantages over purely neural AI, we still need to explain their actions, which are obscured by the interactions of the neural and symbolic components. To address the issue, this paper proposes a formal approach to explaining the decisions of neuro-symbolic systems. The approach hinges on the use of formal abductive explanations and on solving the neuro-symbolic explainability problem hierarchically. Namely, it first computes a formal explanation for the symbolic component of the system, which serves to identify a subset of the individual parts of neural information that needs to be explained. This is followed by explaining only those individual neural inputs, independently of each other, which facilitates succinctness of hierarchical formal explanations and helps to increase the overall performance of the approach. Experimental results for a few complex reasoning tasks demonstrate practical efficiency of the proposed approach, in comparison to purely neural systems, from the perspective of explanation size, explanation time, training time, model sizes, and the quality of explanations reported.

Towards Explainable Neural-Symbolic Visual Reasoning

Which Neural Network Makes More Explainable Decisions? an Approach Towards Measuring Explainability

A Peek Into the Reasoning of Neural Networks: Interpreting with Structural Visual Concepts

Formal Explanations for Neuro-Symbolic AI

Neuro-Symbolic AI: Explainability, Challenges, and Future Trends

Neural Reasoning Networks: Efficient Interpretable Neural Networks With Automatic Textual Explanations

Towards Symbolic XAI -- Explanation Through Human Understandable Logical Relationships Between Features

A Study on Multimodal and Interactive Explanations for Visual Question Answering

Towards Reasoning-Aware Explainable VQA

Foiling Explanations in Deep Neural Networks

From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagation

Neuro-Symbolic Visual Reasoning: Disentangling "Visual" from "Reasoning"

Solving the enigma: Deriving optimal explanations of deep networks

Automated Natural Language Explanation of Deep Visual Neurons with Large Models

Explainable and Explicit Visual Reasoning Over Scene Graphs

The future of human-centric eXplainable Artificial Intelligence (XAI) is not post-hoc explanations

Explainable AI: A review of applications to neuroimaging data

Explaining Explanations: An Overview of Interpretability of Machine Learning

Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models

Explaining Deep Neural Networks by Leveraging Intrinsic Methods

Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs