Abstract:Automatic segmentation and classification of lesions are two clinically significant tasks in the computer-aided diagnosis of skin diseases. Both tasks are challenging due to the nonnegligible lesion differences in dermoscopic images from different patients. In this paper, we propose a novel pipeline to efficiently implement skin lesions' segmentation and classification tasks, which consists of a segmentation network and a classification network. To improve the performance of the segmentation network, we propose a novel module of Multi -Scale Holistic Feature Exploration (MSH) to thoroughly exploit perceptual clues latent among multi-scale feature maps as synthesized by the decoder. The MSH module enables holistic exploration of features across multiple scales to more effectively support downstream image analysis tasks. To boost the performance of the classification network, we propose a novel module of Cross-Modality Collaborative Feature Exploration (CMC) to discover latent discriminative features by collaboratively exploiting potential relationships between cross -modal features of dermoscopic images and clinical metadata. The CMC module enables dynamically capturing versatile interaction effects among cross-modal features during the model's representation learning procedure by discriminatively and adaptively learning the interaction weight associated with each crossmodality feature pair. In addition, to effectively reduce background noise and boost the lesion discrimination ability of the classification network, we crop the images based on lesion masks generated by the best segmentation model. We evaluate the proposed pipeline on the four public skin lesion datasets, where the ISIC 2018 and PH2 are for segmentation, and the ISIC 2019 and ISIC 2020 are combined into a new dataset, ISIC 2019&2020, for classification. It achieves a Jaccard index of 83.31% and 90.14% in skin lesion segmentation, an AUC of 97.98% and an Accuracy of 92.63% in skin lesion classification, which is superior to the performance of representative state-of-the-art skin lesion segmentation and classification methods. Last but not least, the new model for segmentation utilizes much fewer model parameters (3.3 M) than its peer approaches, leading to a greatly reduced number of labeled samples required for model training, which obtains substantially stronger robustness than its peers.

Radiomic and deep learning analysis of dermoscopic images for skin lesion pattern decoding

Skin Lesion Analysis Towards Melanoma Detection Using Deep Learning Network

Deep Learning-Based Semantic Segmentation of Non-Melanocytic Skin Tumors in Whole-Slide Histopathological Images.

Dermoscopy-based Radiomics Help Distinguish Basal Cell Carcinoma and Actinic Keratosis: A Large-scale Real-world Study Based on a 207-combination Machine Learning Computational Framework

Analysis of skin lesion images with deep learning

Intelligent Data Analytics for Diagnosing Melanoma Skin Lesions via Deep Learning in IoT System

Learning from Dermoscopic Images in Association with Clinical Metadata for Skin Lesion Segmentation and Classification

Dermoscopic Image Classification Using Attention Mechanism and Ensemble Learning Approaches

What evidence does deep learning model use to classify Skin Lesions?

Skin Lesion Classification in Dermoscopy Images Using Synergic Deep Learning.

A novel framework of multiclass skin lesion recognition from dermoscopic images using deep learning and explainable AI

Segmentation and classification of skin lesions using hybrid deep learning method in the Internet of Medical Things

Ensemble of Deep Convolutional Neural Network for Skin Lesion Classification in Dermoscopy Images

Application of multi-classification method of skin cancer based on dermoscopic image.

Automated Multi-Class Classification of Skin Lesions Through Deep Convolutional Neural Network with Dermoscopic Images.

Application of deep learning radiomics in oral squamous cell carcinoma—Extracting more information from medical images using advanced feature analysis

Automated lesion segmentation and dermoscopic feature segmentation for skin cancer analysis

A Non-Invasive Interpretable Diagnosis of Melanoma Skin Cancer Using Deep Learning and Ensemble Stacking of Machine Learning Models

Deep Learning With Radiomics for Disease Diagnosis and Treatment: Challenges and Potential

Deep learning-assisted multispectral imaging for early screening of skin diseases

Discovery Radiomics via Deep Multi-Column Radiomic Sequencers for Skin Cancer Detection