Abstract:Automatic segmentation and classification of lesions are two clinically significant tasks in the computer-aided diagnosis of skin diseases. Both tasks are challenging due to the nonnegligible lesion differences in dermoscopic images from different patients. In this paper, we propose a novel pipeline to efficiently implement skin lesions' segmentation and classification tasks, which consists of a segmentation network and a classification network. To improve the performance of the segmentation network, we propose a novel module of Multi -Scale Holistic Feature Exploration (MSH) to thoroughly exploit perceptual clues latent among multi-scale feature maps as synthesized by the decoder. The MSH module enables holistic exploration of features across multiple scales to more effectively support downstream image analysis tasks. To boost the performance of the classification network, we propose a novel module of Cross-Modality Collaborative Feature Exploration (CMC) to discover latent discriminative features by collaboratively exploiting potential relationships between cross -modal features of dermoscopic images and clinical metadata. The CMC module enables dynamically capturing versatile interaction effects among cross-modal features during the model's representation learning procedure by discriminatively and adaptively learning the interaction weight associated with each crossmodality feature pair. In addition, to effectively reduce background noise and boost the lesion discrimination ability of the classification network, we crop the images based on lesion masks generated by the best segmentation model. We evaluate the proposed pipeline on the four public skin lesion datasets, where the ISIC 2018 and PH2 are for segmentation, and the ISIC 2019 and ISIC 2020 are combined into a new dataset, ISIC 2019&2020, for classification. It achieves a Jaccard index of 83.31% and 90.14% in skin lesion segmentation, an AUC of 97.98% and an Accuracy of 92.63% in skin lesion classification, which is superior to the performance of representative state-of-the-art skin lesion segmentation and classification methods. Last but not least, the new model for segmentation utilizes much fewer model parameters (3.3 M) than its peer approaches, leading to a greatly reduced number of labeled samples required for model training, which obtains substantially stronger robustness than its peers.

A Classification-Guided Segmentation Algorithm Based on Deep Learning for Epithelium Segmentation in Histopathological Images of Radicular Cysts

Deep Learning-Based Semantic Segmentation of Non-Melanocytic Skin Tumors in Whole-Slide Histopathological Images.

Epithelium segmentation using deep learning in H&E-stained prostate specimens with immunohistochemistry as reference standard

A machine learning model for separating epithelial and stromal regions in oral cavity squamous cell carcinomas using H&E-stained histology images: A multi-center, retrospective study

Accurate Segmentation of Nuclei in Pathological Images Via Sparse Reconstruction and Deep Convolutional Networks

Cervical Nuclei Segmentation in Whole Slide Histopathology Images Using Convolution Neural Network

Segmentation of the cervical lesion region in colposcopic images based on deep learning

An Automatic Histopathological Image Segmentation Network Based on Global Context-Aware Module and Deep Feature Aggregation

Automatic cell nuclei segmentation and classification of cervical Pap smear images

A Deep Convolutional Network for Pixel-wise Segmentation on Epithelial and Stromal Tissues in Histologic Images

Automated Segmentation of Skin Lesion Based on Pyramid Attention Network.

Deep learning and multiscale analysis for epithelial-mesenchyme segmentation and classification in breast cancer histological images

Advances in Kidney Biopsy Lesion Assessment through Dense Instance Segmentation

Dual-path network with synergistic grouping loss and evidence driven risk stratification for whole slide cervical image analysis

A Deep Learning-Based Approach for Glomeruli Instance Segmentation from Multistained Renal Biopsy Pathologic Images

Learning from Dermoscopic Images in Association with Clinical Metadata for Skin Lesion Segmentation and Classification

Pathology Image Analysis Using Segmentation Deep Learning Algorithms

A Practical Segmentation Method for Automated Screening of Cervical Cytology

A Deep Learning Approach for Colonoscopy Pathology WSI Analysis: Accurate Segmentation and Classification

Automated Segmentation of the Epidermis Area in Skin Whole Slide Histopathological Images.

Multiple Morphological Constraints-Based Complex Gland Segmentation in Colorectal Cancer Pathology Image Analysis