Abstract:Purpose The lack of finely annotated pathologic data has limited the application of deep learning systems (DLS) to the automated interpretation of pathologic slides. Therefore, this study develops a robust self-supervised learning (SSL) pathology diagnostic system to automatically detect malignant melanoma (MM) in the eyelid with limited annotation. Design Development of a self-supervised diagnosis pipeline based on a public dataset, then refined and tested on a private, real-world clinical dataset. Subjects A. Patchcamelyon (PCam)-a publicly accessible dataset for the classification task of patch-level histopathologic images. B. The Second Affiliated Hospital, Zhejiang University School of Medicine (ZJU-2) dataset – 524,307 patches (small sections cut from pathologic slide images) from 192 H&E-stained whole-slide-images (WSIs); only 72 WSIs were labeled by pathologists. Methods Patchcamelyon was used to select a convolutional neural network (CNN) as the backbone for our SSL-based model. This model was further developed in the ZJU-2 dataset for patch-level classification with both labeled and unlabeled images to test its diagnosis ability. Then the algorithm retrieved information based on patch-level prediction to generate WSI-level classification results using random forest. A heatmap was computed for visualizing the decision-making process. Main outcome measure(s) The area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity were used to evaluate the performance of the algorithm in identifying MM. Results ResNet50 was selected as the backbone of the SSL-based model using the PCam dataset. This algorithm then achieved an AUC of 0.981 with an accuracy, sensitivity, and specificity of 90.9, 85.2, and 96.3% for the patch-level classification of the ZJU-2 dataset. For WSI-level diagnosis, the AUC, accuracy, sensitivity, and specificity were 0.974, 93.8%, 75.0%, and 100%, separately. For every WSI, a heatmap was generated based on the malignancy probability. Conclusion Our diagnostic system, which is based on SSL and trained with a dataset of limited annotation, can automatically identify MM in pathologic slides and highlight MM areas in WSIs by a probabilistic heatmap. In addition, this labor-saving and cost-efficient model has the potential to be refined to help diagnose other ophthalmic and non-ophthalmic malignancies.

Deep Learning-Based Accurate Diagnosis of Eyelid Malignant Melanoma from Gigapixel Pathologic Slides

Automated identification of malignancy in whole-slide pathological images: identification of eyelid malignant melanoma in gigapixel pathological slides using deep learning

A Deep Learning Approach with Cascade-network Design for Eyelid Tumors Diagnosis Based on Gigapixel Histopathology Images

Self-supervised learning mechanism for identification of eyelid malignant melanoma in pathologic slides with limited annotation

MAC-ResNet: Knowledge Distillation Based Lightweight Multiscale-Attention-Crop-ResNet for Eyelid Tumors Detection and Classification.

[Deep learning-based fully automated intelligent and precise diagnosis for melanocytic lesions]

Diagnostic assessment of deep learning for melanocytic lesions using whole-slide pathological images

Two-Stage Deep Neural Network Via Ensemble Learning for Melanoma Classification

Artificial intelligence to detect malignant eyelid tumors from photographic images

Interpretable Classification from Skin Cancer Histology Slides Using Deep Learning: A Retrospective Multicenter Study

Deep Learning-Based Fully Automated Differential Diagnosis of Eyelid Basal Cell and Sebaceous Carcinoma Using Whole Slide Images

Interpretable Diagnosis for Whole-Slide Melanoma Histology Images Using Convolutional Neural Network

Computer-aided diagnosis of eyelid skin tumors using machine learning

Detection and Localization of Melanoma Skin Cancer in Histopathological Whole Slide Images

Melanoma Classification Using a Novel Deep Convolutional Neural Network with Dermoscopic Images

A novel deep learning framework for accurate melanoma diagnosis integrating imaging and genomic data for improved patient outcomes

Machine-learning convergent melanocytic morphology despite noisy archival slides

Deep Learning Classifier with Patient's Metadata of Dermoscopic Images in Malignant Melanoma Detection

HM_ADET: a hybrid model for automatic detection of eyelid tumors based on photographic images

Intelligent Data Analytics for Diagnosing Melanoma Skin Lesions via Deep Learning in IoT System

Combining hyperspectral imaging techniques with deep learning to aid in early pathological diagnosis of melanoma