Abstract:The idea I propose in this paper is a method that is based on comprehensive functions for directed and undirected rule extraction from artificial neural network operations. Firstly, I defined comprehensive functions, then constructed a comprehensive multilayer network (denoted as $N$). Each activation function of $N$ is parametrized to a comprehensive function. Following $N$ construction, I extracted rules from the network by observing that the network output depends on probabilities of composite functions that are comprehensive functions. This functional rule extraction method applies to the perceptron and multilayer neural network. For any $N$ model that is trained to predict some outcome given some event, that model behaviour can be expressed â€“ using the functional rule extraction method â€“ as a formal rule or informal rule obeyed by the network to predict that outcome. As example, figure 1 consist of a comprehensive physics function that is parameter for one of the network hidden activation functions. Using the functional rule extraction method, I deduced that the comprehensive multilayer network prediction depends on probability of that physics function and probabilities of other composite comprehensive functions in $N$. Additionally, functional rule extraction method can aid in applied settings for generation of equations of learned phenomena. This generation can be achieved by first training an $N$ model toward predicting outcome of a phenomenon, then extracting the rules and assuming that probability values of the network comprehensive functions are constants. Finally, to simplify the generated equation, comprehensive functions with probability $p = 0$ can be omitted.

Rule Extraction from Artificial Neural Network with Optimized Activation Functions

AN APPROACH TO RULE EXTRACTION OF NEURAL NETWORKS

Rule Extraction using Artificial Neural Networks

Extraction of Symbolic Rules from Artificial Neural Networks

Regression Rules Extraction from Artificial Neural Network Based on Least Squares

Rule Extraction From Compact Pareto-Optimal Neural Networks

Functional Rule Extraction Method for Artificial Neural Networks

Using Two-Phase Approach to Extract Knowledge from Artificial Neural Networks

Extract Interpretability-Accuracy balanced Rules from Artificial Neural Networks: A Review

Novel approach for explaining the behavior of trained artificial neural networks with distributed representations

Rule Extraction Algorithm for Deep Neural Networks: A Review

Extracting Fuzzy Rules From Neural Network In Connectionist Expert System

Rules Extraction from ANN Based on Clustering

Research on Rules Extraction from Neural Network based on Linear Insertion

Rule Extraction from Binary Neural Networks with Convolutional Rules for Model Validation

A Simple Rule Extraction Method Using A Compact Rbf Neural Network

An Algorithm to Extract Rules from Artificial Neural Networks for Medical Diagnosis Problems

Linguistic Rule Extraction from a Simplified RBF Neural Network

Regression rules extraction from neural network based on piecewise linear function intelligent insertion

REx: An Efficient Rule Generator

Rule Extraction by Genetic Algorithms Based on a Simplified RBF Neural Network