Abstract:Background: Deep convolutional neural networks (CNNs) have yielded promising results in automatic whole slide images (WSIs) processing for digital pathology in recent years. Training supervised CNNs usually requires a large amount of annotated samples. However, manual annotation of gigapixel WSIs is labor-intensive and error-prone, i.e., the shortage of annotations has become the major bottleneck of WSI diagnosis model development. In this work, we aim to develop a deep learning based self-supervised histopathology image analysis workflow that can classify tissues without any annotation. Methods: Inspired by the contrastive learning methods that have achieved state-of-the-art results on unsupervised representation learning for natural images, we adopt the self-supervised training scheme to generate discriminative embeddings from annotation-free WSI patches and simultaneously obtain initial clusters, which are further refined by a silhouette coefficient based recursive scheme to divide tissue mixture clusters. A multi-scale encoder network is specifically designed to extract pathology-specific contextual features. A tissue dictionary composed by the tissue clusters is then built for cancer diagnosis. Results: Experiments show that our method can identify different tissues in annotation-free conditions with competitive results (achieving the accuracy of 0.9364/0.9325 in human colorectal/sentinel lymph WSIs) as the supervised methods (with the corresponding accuracy of 0.9806/0.9494) and surpass other unsupervised baselines. Our method is also evaluated in a cohort of 20 clinical patients and get an AUC score of 0.99 to distinguish benign/malignant polyps. Conclusion: Our proposed deep contrastive learning based tissue clustering method can learn from raw WSIs without annotation to distinguish different tissues. The method are tested in three different datasets and show the potential to help pathologists diagnosing diseases as a quantitative and qualitative tool.

When Machine Vision Meets Histology: A Comparative Evaluation of Model Architecture for Classification of Histology Sections

Large Scale Tissue Histopathology Image Classification, Segmentation, and Visualization Via Deep Convolutional Activation Features

Interpretable Inference and Classification of Tissue Types in Histological Colorectal Cancer Slides Based on Ensembles Adaptive Boosting Prototype Tree.

Automated Brain Histology Classification Using Machine Learning

Toward Robust Histology-Prior Embedding for Endomicroscopy Image Classification

A Scalable Graph-Based Framework for Multi-Organ Histology Image Classification

Multiresolution Self-Supervised Feature Integration via Attention Multiple Instance Learning for Histopathology Analysis

Fully Convolutional Neural Networks for Tissue Histopathology Image Classification and Segmentation

Histopathological Image Classification with Cell Morphology Aware Deep Neural Networks

Classification in Histopathology: A unique deep embeddings extractor for multiple classification tasks

A pathology foundation model for cancer diagnosis and prognosis prediction

A multi-resolution model for histopathology image classification and localization with multiple instance learning

Machine learning for cell classification and neighborhood analysis in glioma tissue

Improving High Resolution Histology Image Classification with Deep Spatial Fusion Network

From modern CNNs to vision transformers: Assessing the performance, robustness, and classification strategies of deep learning models in histopathology

Integrative Analysis of Cellular Morphometric Context Reveals Clinically Relevant Signatures in Lower Grade Glioma.

An attention-based multi-resolution model for prostate whole slide imageclassification and localization

Deep contrastive learning based tissue clustering for annotation-free histopathology image analysis

Prediction of Tumor-Associated Macrophages and Immunotherapy Benefits Using Weakly Supervised Contrastive Learning in Breast Cancer Pathology Images

A semi-supervised learning approach with consistency regularization for tumor histopathological images analysis

A Deep Learning Approach for Tissue Spatial Quantification and Genomic Correlations of Histopathological Images