Abstract:Background: Deep convolutional neural networks (CNNs) have yielded promising results in automatic whole slide images (WSIs) processing for digital pathology in recent years. Training supervised CNNs usually requires a large amount of annotated samples. However, manual annotation of gigapixel WSIs is labor-intensive and error-prone, i.e., the shortage of annotations has become the major bottleneck of WSI diagnosis model development. In this work, we aim to develop a deep learning based self-supervised histopathology image analysis workflow that can classify tissues without any annotation. Methods: Inspired by the contrastive learning methods that have achieved state-of-the-art results on unsupervised representation learning for natural images, we adopt the self-supervised training scheme to generate discriminative embeddings from annotation-free WSI patches and simultaneously obtain initial clusters, which are further refined by a silhouette coefficient based recursive scheme to divide tissue mixture clusters. A multi-scale encoder network is specifically designed to extract pathology-specific contextual features. A tissue dictionary composed by the tissue clusters is then built for cancer diagnosis. Results: Experiments show that our method can identify different tissues in annotation-free conditions with competitive results (achieving the accuracy of 0.9364/0.9325 in human colorectal/sentinel lymph WSIs) as the supervised methods (with the corresponding accuracy of 0.9806/0.9494) and surpass other unsupervised baselines. Our method is also evaluated in a cohort of 20 clinical patients and get an AUC score of 0.99 to distinguish benign/malignant polyps. Conclusion: Our proposed deep contrastive learning based tissue clustering method can learn from raw WSIs without annotation to distinguish different tissues. The method are tested in three different datasets and show the potential to help pathologists diagnosing diseases as a quantitative and qualitative tool.

Self-supervised Learning Based on Domain Interpolation for Histopathological Image Analysis

Space and Level Cooperation Framework for Pathological Cancer Grading

(SR)-R-3: Self-supervised Spectral Regression for Hyperspectral Histopathology Image Classification

Domain-specific optimization and diverse evaluation of self-supervised models for histopathology

Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotations

S^3R: Self-supervised Spectral Regression for Hyperspectral Histopathology Image Classification

Self-supervised Visual Representation Learning for Histopathological Images

Stain-Adaptive Self-Supervised Learning for Histopathology Image Analysis

Deep contrastive learning based tissue clustering for annotation-free histopathology image analysis

Semi-supervised segmentation of hyperspectral pathological imagery based on shape priors and contrastive learning

HistoSSL: Self-Supervised Representation Learning for Classifying Histopathology Images

Domain-specific Knowledge Guided Self-supervised Learning for Pathological Image Segmentation.

Mind the Gap: Scanner-induced domain shifts pose challenges for representation learning in histopathology

SSLP: Spatial Guided Self-supervised Learning on Pathological Images

Pancreatic cancer pathology image segmentation with channel and spatial long-range dependencies

Spatial-temporal Hierarchical Reinforcement Learning for Interpretable Pathology Image Super-Resolution

Predicting cancer outcomes from whole slide images via hybrid supervision learning

Unsupervised Pathology Image Segmentation Using Representation Learning with Spherical K-means

Pseudo-Data based Self-Supervised Federated Learning for Classification of Histopathological Images

Nucleus-Aware Self-Supervised Pretraining Using Unpaired Image-to-Image Translation for Histopathology Images.

Hybrid unsupervised representation learning and pseudo-label supervised self-distillation for rare disease imaging phenotype classification with dispersion-aware imbalance correction