Abstract:Deep convolutional neural networks have proven their effectiveness, and have been acknowledged as the most dominant method for image classification. However, a severe drawback of deep convolutional neural networks is poor explainability. Unfortunately, in many real-world applications, users need to understand the rationale behind the predictions of deep convolutional neural networks when determining whether they should trust the predictions or not. To resolve this issue, a novel genetic algorithm-based method is proposed for the first time to automatically evolve local explanations that can assist users to assess the rationality of the predictions. Furthermore, the proposed method is model-agnostic, i.e., it can be utilised to explain any deep convolutional neural network models. In the experiments, ResNet is used as an example model to be explained, and the ImageNet dataset is selected as the benchmark dataset. DenseNet and MobileNet are further explained to demonstrate the model-agnostic characteristic of the proposed method. The evolved local explanations on four images, randomly selected from ImageNet, are presented, which show that the evolved local explanations are straightforward to be recognised by humans. Moreover, the evolved explanations can explain the predictions of deep convolutional neural networks on all four images very well by successfully capturing meaningful interpretable features of the sample images. Further analysis based on the 30 runs of the experiments exhibits that the evolved local explanations can also improve the probabilities/confidences of the deep convolutional neural network models in making the predictions. The proposed method can obtain local explanations within one minute, which is more than ten times faster than LIME (the state-of-the-art method).

A Pixel-Level Explainable Approach of Convolutional Neural Networks and Its Application

Which Neural Network Makes More Explainable Decisions? an Approach Towards Measuring Explainability

Statistic-CAM: A Gradient-Free Visual Explanations for Deep Convolutional Network

Explaining Deep Convolutional Neural Networks for Image Classification by Evolving Local Interpretable Model-agnostic Explanations

Deeper Interpretability of Deep Networks

Towards Robust Visual Explanations for Deep Convolutional Networks with Weight-Wise Perturbations

Human-centric Transfer Learning Explanation Via Knowledge Graph [extended Abstract]

Reliable or Deceptive? Investigating Gated Features for Smooth Visual Explanations in CNNs

Learning local discrete features in explainable-by-design convolutional neural networks

Interpretable Network Visualizations: A Human-in-the-Loop Approach for Post-hoc Explainability of CNN-based Image Classification

Improving Network Interpretability via Explanation Consistency Evaluation

PICNN: A Pathway towards Interpretable Convolutional Neural Networks

Unsupervised Learning of Neural Networks to Explain Neural Networks (extended abstract)

Unsupervised Learning of Neural Networks to Explain Neural Networks

Prob-POS: A Framework for Improving Visual Explanations from Convolutional Neural Networks for Remote Sensing Image Classification

Invertible Concept-based Explanations for CNN Models with Non-negative Concept Activation Vectors

On Fine-Grained Visual Explanation in Convolutional Neural Networks

Spatial-temporal Concept Based Explanation of 3D ConvNets.

Aligning Characteristic Descriptors with Images for Human-Expert-like Explainability

What Does a Model Really Look at?: Extracting Model-Oriented Concepts for Explaining Deep Neural Networks

Faithful and Plausible Natural Language Explanations for Image Classification: A Pipeline Approach