Abstract:AI models have shown promise in many medical imaging tasks. However, our ability to explain what signals these models have learned is severely lacking. Explanations are needed in order to increase the trust in AI-based models, and could enable novel scientific discovery by uncovering signals in the data that are not yet known to experts. In this paper, we present a method for automatic visual explanations leveraging team-based expertise by generating hypotheses of what visual signals in the images are correlated with the task. We propose the following 4 steps: (i) Train a classifier to perform a given task (ii) Train a classifier guided StyleGAN-based image generator (StylEx) (iii) Automatically detect and visualize the top visual attributes that the classifier is sensitive towards (iv) Formulate hypotheses for the underlying mechanisms, to stimulate future research. Specifically, we present the discovered attributes to an interdisciplinary panel of experts so that hypotheses can account for social and structural determinants of health. We demonstrate results on eight prediction tasks across three medical imaging modalities: retinal fundus photographs, external eye photographs, and chest radiographs. We showcase examples of attributes that capture clinically known features, confounders that arise from factors beyond physiological mechanisms, and reveal a number of physiologically plausible novel attributes. Our approach has the potential to enable researchers to better understand, improve their assessment, and extract new knowledge from AI-based models. Importantly, we highlight that attributes generated by our framework can capture phenomena beyond physiology or pathophysiology, reflecting the real world nature of healthcare delivery and socio-cultural factors. Finally, we intend to release code to enable researchers to train their own StylEx models and analyze their predictive tasks.

Generating Post-Hoc Explanation from Deep Neural Networks for Multi-Modal Medical Image Analysis Tasks

Enhancing Deep Learning Model Explainability in Brain Tumor Datasets using Post-Heuristic Approaches

Improving Interpretability of Deep Neural Networks in Medical Diagnosis by Investigating the Individual Units

Evaluating Explainable AI on a Multi-Modal Medical Imaging Task: Can Existing Algorithms Fulfill Clinical Requirements?

Using generative AI to investigate medical imagery models and datasets

Visual Interpretable and Explainable Deep Learning Models for Brain Tumor MRI and COVID-19 Chest X-ray Images

Explainability in CNN based Deep Learning models for medical image classification

Towards Multi-dimensional Explanation Alignment for Medical Classification

Aligning Human Knowledge with Visual Concepts Towards Explainable Medical Image Classification

Quantitative and Qualitative Evaluation of Explainable Deep Learning Methods for Ophthalmic Diagnosis

Improving Explainability of Disentangled Representations using Multipath-Attribution Mappings

Are Explanations Helpful? A Comparative Analysis of Explainability Methods in Skin Lesion Classifiers

Explainable Artificial Intelligence for Human Decision-Support System in Medical Domain

Gradient-free Post-hoc Explainability Using Distillation Aided Learnable Approach

Pixel-Level Explanation of Multiple Instance Learning Models in Biomedical Single Cell Images

Multimodal Explanations: Justifying Decisions and Pointing to the Evidence

Explainable AI: A review of applications to neuroimaging data

Saliency-driven explainable deep learning in medical imaging: bridging visual explainability and statistical quantitative analysis

Generation of Multimodal Justification Using Visual Word Constraint Model for Explainable Computer-Aided Diagnosis

Grad-CAM-Based Explainable Artificial Intelligence Related to Medical Text Processing