Abstract:Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for automatic medical image classification. Although remarkable advancement has been made, they have not demonstrated sufficiently accurate and robust results for clinical use. In addition, they are limited by the unavoidable hard samples and minority class samples. Meanwhile, it is hard to understand the prediction mechanism and debug the wrong prediction. To address these issues, this paper proposes a Self-Optimizing medical image classification framework based on category-aware feature attribution, which automatically performs model diagnosis, repairing, and enhancement. On one hand, we introduce selective filter restraining to alleviate the disturbance of misclassified features for hard samples. On the other hand, we introduce sample-specific fine-tuning to promote category-wise feature learning, especially for minority classes. The Self-Optimizing framework is a versatile module for other medical image classifiers based on mainstream CNN structures. We extensively validated the proposed method on three typical yet challenging medical image classification tasks: (i) skin lesion classification from dermoscopic images in the International Skin Imaging Collaboration (ISIC) 2019 dataset, (ii) breast cancer classification from ultrasound images in Breast Ultrasound Images (BUSI) dataset, and (iii) breast tumour classification from histopathologic scans of lymph node sections in PatchCamelyon (PCam) dataset. Experimental results demonstrate that the proposed framework achieves 1%∼5% performance gain for various classifiers, brings better explainability, and can be applied to incremental learning scenarios.

Enhancing Interpretability in Medical Image Classification by Integrating Formal Concept Analysis with Convolutional Neural Networks

Exploring Explainable AI Techniques for Improved Interpretability in Lung and Colon Cancer Classification

Towards Multi-dimensional Explanation Alignment for Medical Classification

Interpretable breast cancer classification using CNNs on mammographic images

Interpreting Medical Image Classifiers by Optimization Based Counterfactual Impact Analysis

Concept-Attention Whitening for Interpretable Skin Lesion Diagnosis

IGCNN-FC: Boosting Interpretability and Generalization of Convolutional Neural Networks for Few Chest X-rays Analysis

FSCNN: Fuzzy Channel Filter-Based Separable Convolution Neural Networks for Medical Imaging Recognition

Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Models

Enhancing Radiology Diagnosis through Convolutional Neural Networks for Computer Vision in Healthcare

Understanding Anatomy Classification Through Attentive Response Maps

A Novel Attention-based Explainable Deep Learning Framework Towards Medical Image Classification

Feature CAM: Interpretable AI in Image Classification

Non-Local Attention Learning for Medical Image Classification

On Interpretability of Deep Learning based Skin Lesion Classifiers using Concept Activation Vectors

Category-aware Feature Attribution for Self-Optimizing Medical Image Classification

Feature-Based Interpretation of Image Classification With the Use of Convolutional Neural Networks

Double Attention for Pathology Image Diagnosis Network with Visual Interpretability.

Enhancing Breast Cancer Diagnosis in Mammography: Evaluation and Integration of Convolutional Neural Networks and Explainable AI

A Cognitive Explainer for Fetal ultrasound images classifier Based on Medical Concepts

MEDICAL IMAGING ENHANCEMENT WITH AI MODELS FOR AUTOMATIC DISEASE DETECTION AND CLASSIFICATION BASED ON MEDICAL IMAGES