Abstract:Purpose The lack of finely annotated pathologic data has limited the application of deep learning systems (DLS) to the automated interpretation of pathologic slides. Therefore, this study develops a robust self-supervised learning (SSL) pathology diagnostic system to automatically detect malignant melanoma (MM) in the eyelid with limited annotation. Design Development of a self-supervised diagnosis pipeline based on a public dataset, then refined and tested on a private, real-world clinical dataset. Subjects A. Patchcamelyon (PCam)-a publicly accessible dataset for the classification task of patch-level histopathologic images. B. The Second Affiliated Hospital, Zhejiang University School of Medicine (ZJU-2) dataset – 524,307 patches (small sections cut from pathologic slide images) from 192 H&E-stained whole-slide-images (WSIs); only 72 WSIs were labeled by pathologists. Methods Patchcamelyon was used to select a convolutional neural network (CNN) as the backbone for our SSL-based model. This model was further developed in the ZJU-2 dataset for patch-level classification with both labeled and unlabeled images to test its diagnosis ability. Then the algorithm retrieved information based on patch-level prediction to generate WSI-level classification results using random forest. A heatmap was computed for visualizing the decision-making process. Main outcome measure(s) The area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity were used to evaluate the performance of the algorithm in identifying MM. Results ResNet50 was selected as the backbone of the SSL-based model using the PCam dataset. This algorithm then achieved an AUC of 0.981 with an accuracy, sensitivity, and specificity of 90.9, 85.2, and 96.3% for the patch-level classification of the ZJU-2 dataset. For WSI-level diagnosis, the AUC, accuracy, sensitivity, and specificity were 0.974, 93.8%, 75.0%, and 100%, separately. For every WSI, a heatmap was generated based on the malignancy probability. Conclusion Our diagnostic system, which is based on SSL and trained with a dataset of limited annotation, can automatically identify MM in pathologic slides and highlight MM areas in WSIs by a probabilistic heatmap. In addition, this labor-saving and cost-efficient model has the potential to be refined to help diagnose other ophthalmic and non-ophthalmic malignancies.

Automated identification of malignancy in whole-slide pathological images: identification of eyelid malignant melanoma in gigapixel pathological slides using deep learning

Deep Learning-Based Accurate Diagnosis of Eyelid Malignant Melanoma from Gigapixel Pathologic Slides

Self-supervised learning mechanism for identification of eyelid malignant melanoma in pathologic slides with limited annotation

A Deep Learning Approach with Cascade-network Design for Eyelid Tumors Diagnosis Based on Gigapixel Histopathology Images

A Self-Supervised Learning Based Framework for Eyelid Malignant Melanoma Diagnosis in Whole Slide Images.

Deep learning-based fully automated diagnosis of melanocytic lesions by using whole slide images

Diagnostic assessment of deep learning for melanocytic lesions using whole-slide pathological images

Deep Learning-Based Semantic Segmentation of Non-Melanocytic Skin Tumors in Whole-Slide Histopathological Images.

Deep Learning-Based Fully Automated Differential Diagnosis of Eyelid Basal Cell and Sebaceous Carcinoma Using Whole Slide Images

[Deep learning-based fully automated intelligent and precise diagnosis for melanocytic lesions]

Deep Learning-Based Histopathological Image Analysis for Automated Detection and Staging of Melanoma

Artificial intelligence to detect malignant eyelid tumors from photographic images

Detection and Localization of Melanoma Skin Cancer in Histopathological Whole Slide Images

Automated differentiation of skin melanocytes from keratinocytes in high‐resolution histopathology images using a weakly‐supervised deep‐learning framework

Utilizing deep learning model for assessing melanocytic density in resection margins of lentigo maligna

Automated analysis and diagnosis of skin melanoma on whole slide histopathological images

Computer-aided diagnosis of eyelid skin tumors using machine learning

Automated Diagnosis of Lymphoma with Digital Pathology Images Using Deep Learning

Automated Diagnosis of Melanoma Histopathological Images Based on Deep Learning Using Trust Counting Method

Deep learning shows the capability of high-level computer-aided diagnosis in malignant lymphoma

Development and validation of a deep learning model for improving detection of nonmelanoma skin cancers treated with Mohs micrographic surgery