Abstract:One principal impediment in the successful deployment of AI-based Computer-Aided Diagnosis (CAD) systems in clinical workflows is their lack of transparent decision making. Although commonly used eXplainable AI methods provide some insight into opaque algorithms, such explanations are usually convoluted and not readily comprehensible except by highly trained experts. The explanation of decisions regarding the malignancy of skin lesions from dermoscopic images demands particular clarity, as the underlying medical problem definition is itself ambiguous. This work presents ExAID (Explainable AI for Dermatology), a novel framework for biomedical image analysis, providing multi-modal concept-based explanations consisting of easy-to-understand textual explanations supplemented by visual maps justifying the predictions. ExAID relies on Concept Activation Vectors to map human concepts to those learnt by arbitrary Deep Learning models in latent space, and Concept Localization Maps to highlight concepts in the input space. This identification of relevant concepts is then used to construct fine-grained textual explanations supplemented by concept-wise location information to provide comprehensive and coherent multi-modal explanations. All information is comprehensively presented in a diagnostic interface for use in clinical routines. An educational mode provides dataset-level explanation statistics and tools for data and model exploration to aid medical research and education. Through rigorous quantitative and qualitative evaluation of ExAID, we show the utility of multi-modal explanations for CAD-assisted scenarios even in case of wrong predictions. We believe that ExAID will provide dermatologists an effective screening tool that they both understand and trust. Moreover, it will be the basis for similar applications in other biomedical imaging fields.

Exemplars and Counterexemplars Explanations for Image Classifiers, Targeting Skin Lesion Labeling

Explainable Deep Image Classifiers for Skin Lesion Diagnosis

Improving trust and confidence in medical skin lesion diagnosis through explainable deep learning

Advancing Dermatological Diagnostics: Interpretable AI for Enhanced Skin Lesion Classification

Are Explanations Helpful? A Comparative Analysis of Explainability Methods in Skin Lesion Classifiers

Aligning Characteristic Descriptors with Images for Human-Expert-like Explainability

Aligning Human Knowledge with Visual Concepts Towards Explainable Medical Image Classification

Achievements and Challenges in Explaining Deep Learning based Computer-Aided Diagnosis Systems

ExplAIn: Explanatory Artificial Intelligence for Diabetic Retinopathy Diagnosis

ExAID: A Multimodal Explanation Framework for Computer-Aided Diagnosis of Skin Lesions

Explainable Deep Classification Models for Domain Generalization

Evaluating the Explainability of Attributes and Prototypes for a Medical Classification Model

Fool Me Once? Contrasting Textual and Visual Explanations in a Clinical Decision-Support Setting

Meaningful Explanation Effect on User’s Trust in an AI Medical System: Designing Explanations for Non-Expert Users

Explainable AI for medical imaging: Explaining pneumothorax diagnoses with Bayesian Teaching

Dermatologist-like explainable AI enhances trust and confidence in diagnosing melanoma

TACE: Tumor-Aware Counterfactual Explanations

Learning by Self-Explaining

Solving the enigma: Deriving optimal explanations of deep networks

Representing visual classification as a linear combination of words

Teaching Meaningful Explanations