Abstract:The paper proposes the approximation of DNNs by replacing each neuron by the corresponding logical-probabilistic neuron. Logical-probabilistic neurons learn their behavior based on the responses of initial neurons on incoming signals and discover all logical-probabilistic causal relationships between the input and output. These logical-probabilistic causal relationships are, in a certain sense, most precise – it was proved in the previous works that they are theoretically (when probability is known) can predict without contradictions. The resulting logical-probabilistic neurons are interconnected by the same connections as the initial neurons after replacing their signals on true/false. The resulting logical-probabilistic neural network produces its own predictions that approximate the predictions of the original DNN. Thus, we obtain an interpretable approximation of DNN, which also allows tracing of DNN by tracing its excitations through the causal relationships. This approximation of DNN is a Distillation method such as Model Translation, which train alternative smaller interpretable models that mimics the total input/output behavior of DNN. It is also locally interpretable and explains every particular prediction. It explains the sequences of logical probabilistic causal relationships that infer that prediction and also show all features that took part in this prediction with the statistical estimation of their significance. Experimental results on approximation accuracy of all intermedia neurons, output neurons and softmax output of DNN are presented, as well as the accuracy of obtained logical-probabilistic neural network. From the practical point of view, interpretable transformation of neural networks is very important for the hybrid artificial intelligent systems, where neural networks are integrated with the symbolic methods of AI. As a practical application we consider smart city.

Neural networks taking probability distributions as input: A framework for analyzing exchangeable networks

Which Neural Network Makes More Explainable Decisions? an Approach Towards Measuring Explainability

Towards Interpreting Recurrent Neural Networks Through Probabilistic Abstraction

Exchangeable Neural ODE for Set Modeling

Bayesian Analysis for Exponential Random Graph Models Using the Adaptive Exchange Sampler.

Random Networks, Graphical Models, and Exchangeability

Edge exchangeable models for network data

Interpretability of Neural Networks with Probability Density Functions

Analyzing Recurrent Neural Network by Probabilistic Abstraction

Functional Network: A Novel Framework for Interpretability of Deep Neural Networks

Stochastic blockmodels for exchangeable collections of networks

Measure, Manifold, Learning, and Optimization: A Theory Of Neural Networks

A Probabilistic Representation of Deep Learning for Improving The Information Theoretic Interpretability

Exchangeable Sequence Models Quantify Uncertainty Over Latent Concepts

Indeterminate Probability Neural Network

Interpretable logical-probabilistic approximation of neural networks

MEP-Net: Generating Solutions to Scientific Problems with Limited Knowledge by Maximum Entropy Principle

Determinable and interpretable network representation for link prediction

An Exchange Rate Forecasting Method Based on Probabilistic Neural Network.

Probabilistically Rewired Message-Passing Neural Networks

How to Explain Neural Networks: an Approximation Perspective