Abstract:Recent advances in machine learning have led to a surge in adoption of neural networks for various tasks, but lack of interpretability remains an issue for many others in which an understanding of the features influencing the prediction is necessary to ensure fairness, safety, and legal compliance. In this paper we consider one class of such tasks, tabular dataset classification, and propose a novel neuro-symbolic architecture, Neural Reasoning Networks (NRN), that is scalable and generates logically sound textual explanations for its predictions. NRNs are connected layers of logical neurons which implement a form of real valued logic. A training algorithm (R-NRN) learns the weights of the network as usual using gradient descent optimization with backprop, but also learns the network structure itself using a bandit-based optimization. Both are implemented in an extension to PyTorch (<a class="link-external link-https" href="https://github.com/IBM/torchlogic" rel="external noopener nofollow">this https URL</a>) that takes full advantage of GPU scaling and batched training. Evaluation on a diverse set of 22 open-source datasets for tabular classification demonstrates performance (measured by ROC AUC) which improves over multi-layer perceptron (MLP) and is statistically similar to other state-of-the-art approaches such as Random Forest, XGBoost and Gradient Boosted Trees, while offering 43% faster training and a more than 2 orders of magnitude reduction in the number of parameters required, on average. Furthermore, R-NRN explanations are shorter than the compared approaches while producing more accurate feature importance scores.

Learning Signal Temporal Logic through Neural Network for Interpretable Classification

Multi-class Temporal Logic Neural Networks

TLINet: Differentiable Neural Network Temporal Logic Inference

Neural Network for Weighted Signal Temporal Logic

A Neurosymbolic Approach to the Verification of Temporal Logic Properties of Learning enabled Control Systems

stl2vec: Semantic and Interpretable Vector Representation of Temporal Logic

Signal Temporal Logic Neural Predictive Control

Tractable Reinforcement Learning of Signal Temporal Logic Objectives

Seeing in Words: Learning to Classify through Language Bottlenecks

Weighted Graph-Based Signal Temporal Logic Inference Using Neural Networks

NSL: Hybrid Interpretable Learning From Noisy Raw Data

Model-based Reinforcement Learning from Signal Temporal Logic Specifications

Neural Reasoning Networks: Efficient Interpretable Neural Networks With Automatic Textual Explanations

Learning Optimal Signal Temporal Logic Decision Trees for Classification: A Max-Flow MILP Formulation

Differentiable Inference of Temporal Logic Formulas

Safe Model-based Control from Signal Temporal Logic Specifications Using Recurrent Neural Networks

Interpretable Fault Diagnosis of Rolling Element Bearings with Temporal Logic Neural Network

DeepSTL -- From English Requirements to Signal Temporal Logic

Interpretable synthetic signals for explainable one-class time-series classification

Neuro-Symbolic Temporal Point Processes

TV-Net: Temporal-Variable feature harmonizing Network for multivariate time series classification and interpretation