Abstract:Owing to the advancements in artificial intelligence (AI) technology, deep learning has found applications in data analysis and problem-related decision-making processes. However, because of the "black-box" characteristics of deep neural networks, the explanations of decision-making processes are ambiguous. Therefore, model developers face challenges while establishing users' trust in these processes and the associated decision results. Understanding and explaining the decision-making processes implemented by deep learning-based predictive models has importance in various fields. Based on existing interpretation algorithms, this study proposed a novel interpretation algorithm for deep convolutional neural network (CNN) models. The proposed algorithm, known as the neural network interpreter-segmentation recognition and interpretation (NNI-SRI) algorithm, uses the general ideas of segmentation and recognition to interpret models. Compared with other mainstream interpretation algorithms, this algorithm has the following advantages. First, it has a higher model interpretation speed. Second, it can label the positive and negative features observed during the model prediction process. Third, fewer parameters and hardware resources are required because only the forward propagation is used. Furthermore, the proposed algorithm showed better scene adaptability under the premise of ensuring the accuracy of interpretation, which is consistent with the CNN convolution process. Theoretically, the NNI-SRI algorithm can be applied to any model, particularly CNN models, such as InceptionV3, Xception, and ResNet. In this study, the interpretation algorithm was applied to the standard Inception deep network model and the spider sex recognition model developed by us, which achieved excellent results and verified the feasibility of the algorithm. (c) 2022 The Author(s). Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Deeper Interpretability of Deep Networks

A Pixel-Level Explainable Approach of Convolutional Neural Networks and Its Application

Visual Interpretability forDeepLearning

Visual Interpretability for Deep Learning: a Survey

Understanding Neural Networks Through Deep Visualization

Towards Interpretable Face Recognition

Exploring Features and Attributes in Deep Face Recognition Using Visualization Techniques

DRNet: Dissect and Reconstruct the Convolutional Neural Network Via Interpretable Manners

Explaining Deep Neural Networks by Leveraging Intrinsic Methods

Towards Better Analysis of Deep Convolutional Neural Networks

Visualizing Deep Networks Using Segmentation Recognition and Interpretation Algorithm

Convolutional Neural Networks Exploiting Attributes of Biological Neurons

PICNN: A Pathway towards Interpretable Convolutional Neural Networks

Deep Face Decoder: Towards understanding the embedding space of convolutional networks through visual reconstruction of deep face templates

Interpretability for Reliable, Efficient, and Self-Cognitive DNNs: from Theories to Applications.

This Looks Like That: Deep Learning for Interpretable Image Recognition

Interpretable Deep Convolutional Neural Networks via Meta-learning

Understanding the Role of Pathways in a Deep Neural Network

Embedding deep networks into visual explanations

A Peek Into the Reasoning of Neural Networks: Interpreting with Structural Visual Concepts