Abstract:Background and ObjectiveThe skin lesion usually covers a small region of the dermoscopy image, and the lesions of different categories might own high similarities. Therefore, it is essential to design an elaborate network for accurate skin lesion classification, which can focus on semantically meaningful lesion parts. Although the Class Activation Mapping (CAM) shows good localization capability of highlighting the discriminative parts, it cannot be obtained in the forward propagation process.MethodsWe propose a Deep Attention Branch Network (DABN) model, which introduces the attention branches to expand the conventional Deep Convolutional Neural Networks (DCNN). The attention branch is designed to obtain the CAM in the training stage, which is then utilized as an attention map to make the network focus on discriminative parts of skin lesions. DABN is applicable to multiple DCNN structures and can be trained in an end-to-end manner. Moreover, a novel Entropy-guided Loss Weighting (ELW) strategy is designed to counter class imbalance influence in the skin lesion datasets.ResultsThe proposed method achieves an Average Precision (AP) of 0.719 on the ISIC-2016 dataset and an average area under the ROC curve (AUC) of 0.922 on the ISIC-2017 dataset. Compared with other state-of-the-art methods, our method obtains better performance without external data and ensemble learning. Moreover, extensive experiments demonstrate that it can be applied to multi-class classification tasks and improves mean sensitivity by more than 2.6% in different DCNN structures.ConclusionsThe proposed method can adaptively focus on the discriminative regions of dermoscopy images and allows for effective training when facing class imbalance, leading to the performance improvement of skin lesion classification, which could also be applied to other clinical applications.

Attention Model Enhancement Network for Breast Tumor Classification

Attention Model Enhanced Network for Classification of Breast Cancer Image

Improved Breast Cancer Classification through Combining Transfer Learning and Attention Mechanism

MDAA: multi-scale and dual-adaptive attention network for breast cancer classification

A deep multi-branch attention model for histopathological breast cancer image classification

Breast Tumor Classification Using EfficientNet Deep Learning Model

Attention-Based Deep Learning Approach for Breast Cancer Histopathological Image Multi-Classification

Joint localization and classification of breast tumors on ultrasound images using a novel auxiliary attention-based framework

Breast cancer X-ray image staging: based on efficient net with multi-scale fusion and cbam attention

Attention guided neural ODE network for breast tumor segmentation in medical images

Multi-Branch Spectral Channel Attention Network for Breast Cancer Histopathology Image Classification

Deep attention branch networks for skin lesion classification

A Lightweight Spatially-Aware Classification Model for Breast Cancer Pathology Images

Multi-stages attention Breast cancer classification based on nonlinear spiking neural P neurons with autapses

Improved Breast Cancer Classification Through Combining Graph Convolutional Network and Convolutional Neural Network

Contextual Features and Information Bottleneck-Based Multi-Input Network for Breast Cancer Classification from Contrast-Enhanced Spectral Mammography

Meta-adaptive-weighting-based bilateral multi-dimensional refined space feature attention network for imbalanced breast cancer histopathological image classification

Fine tuning deep learning models for breast tumor classification

Classification of Breast Cancer Lesions in Ultrasound Images by using Attention Layer and loss Ensembles in Deep Convolutional Neural Networks

Look, Investigate, and Classify: A Deep Hybrid Attention Method for Breast Cancer Classification

Classification of Breast Cancer Lesions in Ultrasound Images by Using Attention Layer and Loss Ensemble in Deep Convolutional Neural Networks