Abstract:Tumor mutation burden (TMB) and VHL mutation play a crucial role in the management of patients with clear cell renal cell carcinoma (ccRCC), but the time‐consuming and expensive high‐throughput sequencing methods severely limit their clinical applicability. Our aim was to develop a self‐supervised attention‐based multiple instance learning (SSL‐ABMIL) model to predict TMB and VHL mutation status from hematoxylin and eosin‐stained histopathological images. Our results indicated that SSL‐ABMIL can effectively extract histological features for predicting TMB and VHL mutation, demonstrating promising results in linking tumor morphology and molecular biology. Background Tumor mutation burden (TMB) and VHL mutation play a crucial role in the management of patients with clear cell renal cell carcinoma (ccRCC), such as guiding adjuvant chemotherapy and improving clinical outcomes. However, the time‐consuming and expensive high‐throughput sequencing methods severely limit their clinical applicability. Predicting intratumoral heterogeneity poses significant challenges in biology and clinical settings. Our aimed to develop a self‐supervised attention‐based multiple instance learning (SSL‐ABMIL) model to predict TMB and VHL mutation status from hematoxylin and eosin‐stained histopathological images. Methods We obtained whole slide images (WSIs) and somatic mutation data of 350 ccRCC patients from The Cancer Genome Atlas for developing SSL‐ABMIL model. In parallel, 163 ccRCC patients from Clinical Proteomic Tumor Analysis Consortium cohort was used as independent external validation set. We systematically compared three different models (Wang‐ABMIL, Ciga‐ABMIL, and ImageNet‐MIL) for their ability to predict TMB and VHL alterations. Results We first identified two groups of populations with high‐ and low‐TMB (cut‐off point = 0.9). In two independent cohorts, the Wang‐ABMIL model achieved the highest performance with decent generalization performance (AUROC = 0.83 ± 0.02 and 0.8 ± 0.04 in predicting TMB and VHL, respectively). Attention heatmaps revealed that the Wang‐ABMIL model paid the highest attention to tumor regions in high‐TMB patients, while in VHL mutation prediction, non‐tumor regions were also assigned high attention, particularly the stromal regions infiltrated by lymphocytes. Conclusions Our results indicated that SSL‐ABMIL can effectively extract histological features for predicting TMB and VHL mutation, demonstrating promising results in linking tumor morphology and molecular biology.

Self-supervised learning mechanism for identification of eyelid malignant melanoma in pathologic slides with limited annotation

Automated identification of malignancy in whole-slide pathological images: identification of eyelid malignant melanoma in gigapixel pathological slides using deep learning

A Self-Supervised Learning Based Framework for Eyelid Malignant Melanoma Diagnosis in Whole Slide Images.

Deep Learning-Based Accurate Diagnosis of Eyelid Malignant Melanoma from Gigapixel Pathologic Slides

A Deep Learning Approach with Cascade-network Design for Eyelid Tumors Diagnosis Based on Gigapixel Histopathology Images

Computer-aided diagnosis of eyelid skin tumors using machine learning

MAC-ResNet: Knowledge Distillation Based Lightweight Multiscale-Attention-Crop-ResNet for Eyelid Tumors Detection and Classification.

Deep Learning-Based Fully Automated Differential Diagnosis of Eyelid Basal Cell and Sebaceous Carcinoma Using Whole Slide Images

Deep learning-based fully automated diagnosis of melanocytic lesions by using whole slide images

Unsupervised sub-segmentation for pigmented skin lesions.

Diagnostic assessment of deep learning for melanocytic lesions using whole-slide pathological images

Artificial intelligence to detect malignant eyelid tumors from photographic images

Self-supervised learning-enhanced deep learning method for identifying myopic maculopathy in high myopia patients

Self-Supervised Multi-Modality Learning for Multi-Label Skin Lesion Classification

[Deep learning-based fully automated intelligent and precise diagnosis for melanocytic lesions]

Differentiating malignant and benign eyelid lesions using deep learning

Predicting tumor mutation burden and VHL mutation from renal cancer pathology slides with self‐supervised deep learning

Learning how to detect: A deep reinforcement learning method for whole-slide melanoma histopathology images

Automated differentiation of skin melanocytes from keratinocytes in high‐resolution histopathology images using a weakly‐supervised deep‐learning framework

Self-Supervised Multiple Instance Learning for Acute Myeloid Leukemia Classification

A Weakly Supervised Deep Learning Model and Human-Machine Fusion for Accurate Grading of Renal Cell Carcinoma from Histopathology Slides.