Abstract:Convolutional neural network is one of the key technologies in the application of image recognition and processing in artificial intelligence.Its wide application makes researches on its robustness more and more important.Previous researches on robustness of neural networks were too sweeping and most of them focused on adversarial robustness, which causes difficulty in further study in the mechanism of neural network robustness.The related researches of neuroscience were introduced and the concept of visual robustness was put forward.By studying the similarity and difference between neural network models and human visual system, the internal mechanism and faults of neural network robustness were revealed.The researches of neural network robustness in recent years were reviewed, and the reasons for the lack of robustness of neural network models were analyzed.The lack of robustness of neural networks is reflected in their sensitivity to small perturbations.The reason is that neural networks tend to learn high-frequency information for calculation and inference, which is difficult for humans to recognize.High-frequency information is easily affected by perturbations, and eventually causes mistakes of models.Previous researches on robustness mostly focused on mathematical properties of models, and were limited in the natural faults of neural networks.Visual robustness extends the traditional concept of robustness.The traditional concept of robustness measures the discrimination ability of models for distorted image examples.Distorted examples and clean examples can get correct outputs through robust models.Visual robustness measures the consistency between models and humans in discrimination ability.Visual robustness combines the research methods and achievements of neuroscience and psychology with artificial intelligence.The development of neuroscience in the field of vision were reviewed, and the application of research methods of cognitive psychology in neural network robustness were discussed.Human visual system has advantages in learning and abstract ability, whill neural network models have better performance in calculation speed and memory.The difference between the physiological structure of human brain and the logical structure of neural network models is the key factor leading to the problem of robustness of neural networks.The research of visual robustness requires deeper understanding of human visual system.Revealing the differences in cognitive mechanism between human visual system and neural network models and effectively improving the algorithm are the development trends of neural network robustness and even artificial intelligence.

Guiding the Comparison of Neural Network Local Robustness: an Empirical Study

Measuring Robustness of Deep Neural Networks from the Lens of Statistical Model Checking.

There is Limited Correlation Between Coverage and Robustness for Deep Neural Networks

An Empirical Study on Correlation between Coverage and Robustness for Deep Neural Networks

Certifying Semantic Robustness of Deep Neural Networks

A Survey of Neural Network Robustness Assessment in Image Recognition

Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspective

Are Adversarial Robustness and Common Perturbation Robustness Independent Attributes ?

Certifying Global Robustness for Deep Neural Networks

Research on the Robustness of Convolutional Neural Networks in Image Recognition

Global Robustness Verification Networks

Sensitivity Analysis of Deep Neural Networks

Local Competition and Uncertainty for Adversarial Robustness in Deep Learning

Analysis of Random Perturbations for Robust Convolutional Neural Networks

Input Validation for Neural Networks via Runtime Local Robustness Verification

SoK: Certified Robustness for Deep Neural Networks

Interpreting and Evaluating Neural Network Robustness

Benchmarking Adversarial Robustness on Image Classification

Analyzing the Noise Robustness of Deep Neural Networks

Not So Robust After All: Evaluating the Robustness of Deep Neural Networks to Unseen Adversarial Attacks

Robustness of Neural Networks: A Probabilistic and Practical Approach