Abstract:With the continuous deepening of Artificial Neural Network (ANN) research, ANN model structure and function are improving towards diversification and intelligence. However, the model is more evaluated from the pros and cons of the problem-solving results and the lack of evaluation from the biomimetic aspect of imitating neural networks is not inclusive enough. Hence, a new ANN models evaluation strategy is proposed from the perspective of bionics in response to this problem in the paper. Firstly, four classical neural network models are illustrated: Back Propagation (BP) network, Deep Belief Network (DBN), LeNet5 network, and olfactory bionic model (KIII model), and the neuron transmission mode and equation, network structure, and weight updating principle of the models are analyzed qualitatively. The analysis results show that the KIII model comes closer to the actual biological nervous system compared with other models, and the LeNet5 network simulates the nervous system in depth. Secondly, evaluation indexes of ANN are constructed from the perspective of bionics in this paper: small-world, synchronous, and chaotic characteristics. Finally, the network model is quantitatively analyzed by evaluation indexes from the perspective of bionics. The experimental results show that the DBN network, LeNet5 network, and BP network have synchronous characteristics. And the DBN network and LeNet5 network have certain chaotic characteristics, but there is still a certain distance between the three classical neural networks and actual biological neural networks. The KIII model has certain small-world characteristics in structure, and its network also exhibits synchronization characteristics and chaotic characteristics. Compared with the DBN network, LeNet5 network, and the BP network, the KIII model is closer to the real biological neural network.

Statistical model-based evaluation of neural networks

A statistical modelling approach to feedforward neural network model selection

A model is worth tens of thousands of examples

Statistical tuning of artificial neural network

A Statistical-Modelling Approach to Feedforward Neural Network Model Selection

An empirical study on evaluation metrics of generative adversarial networks

Active Learning with Statistical Models

Analyzing neural network behavior through deep statistical model checking

Measuring model variability using robust non-parametric testing

A Study on the Evaluation of Generative Models

Modelling Sampling Distributions of Test Statistics with Autograd

Evaluating Neuron Interpretation Methods of NLP Models

Statistical inference on representational geometries

Data Subsampling for Bayesian Neural Networks

A Novel Evaluation Strategy to Artificial Neural Network Model Based on Bionics

An Information-Theoretic Analysis of Compute-Optimal Neural Scaling Laws

On the Evaluation of Generative Adversarial Networks By Discriminative Models

Variational Bayes Neural Network: Posterior Consistency, Classification Accuracy and Computational Challenges

Bayesian-Based Automated Model Generation Method for Neural Network Modeling of Microwave Components

Training Discriminative Models to Evaluate Generative Ones

Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations