Abstract:Deep convolutional neural networks have proven their effectiveness, and have been acknowledged as the most dominant method for image classification. However, a severe drawback of deep convolutional neural networks is poor explainability. Unfortunately, in many real-world applications, users need to understand the rationale behind the predictions of deep convolutional neural networks when determining whether they should trust the predictions or not. To resolve this issue, a novel genetic algorithm-based method is proposed for the first time to automatically evolve local explanations that can assist users to assess the rationality of the predictions. Furthermore, the proposed method is model-agnostic, i.e., it can be utilised to explain any deep convolutional neural network models. In the experiments, ResNet is used as an example model to be explained, and the ImageNet dataset is selected as the benchmark dataset. DenseNet and MobileNet are further explained to demonstrate the model-agnostic characteristic of the proposed method. The evolved local explanations on four images, randomly selected from ImageNet, are presented, which show that the evolved local explanations are straightforward to be recognised by humans. Moreover, the evolved explanations can explain the predictions of deep convolutional neural networks on all four images very well by successfully capturing meaningful interpretable features of the sample images. Further analysis based on the 30 runs of the experiments exhibits that the evolved local explanations can also improve the probabilities/confidences of the deep convolutional neural network models in making the predictions. The proposed method can obtain local explanations within one minute, which is more than ten times faster than LIME (the state-of-the-art method).

Multiple Explanations for Neural Network Based Dropout Prediction

Which Neural Network Makes More Explainable Decisions? an Approach Towards Measuring Explainability

Interpretable Dropout Prediction: Towards XAI-Based Personalized Intervention

Visual analytics of potential dropout behavior patterns in online learning based on counterfactual explanation

How Well Do Feature-Additive Explainers Explain Feature-Additive Predictors?

xAI-Drop: Don't Use What You Cannot Explain

You Can Do Better! if You Elaborate the Reason when Making Prediction.

Sensitivity based Neural Networks Explanations

Disentangled Explanations of Neural Network Predictions by Finding Relevant Subspaces

Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models

Explaining the Predictions of Any Image Classifier via Decision Trees

Excitation Dropout: Encouraging Plasticity in Deep Neural Networks

Explaining Deep Convolutional Neural Networks for Image Classification by Evolving Local Interpretable Model-agnostic Explanations

Quantifying Explainability in Outcome-Oriented Predictive Process Monitoring

R-Drop: Regularized Dropout for Neural Networks.

Understanding the (Extra-)Ordinary: Validating Deep Model Decisions with Prototypical Concept-based Explanations

Investigating Explainability Methods in Recurrent Neural Network Architectures for Financial Time Series Data

Cooperative Explanations of Graph Neural Networks.

Model Interpretation and Explainability: Towards Creating Transparency in Prediction Models

Gradient based Feature Attribution in Explainable AI: A Technical Review

Solving the enigma: Deriving optimal explanations of deep networks