Abstract:Background: Deep convolutional neural networks (CNNs) have yielded promising results in automatic whole slide images (WSIs) processing for digital pathology in recent years. Training supervised CNNs usually requires a large amount of annotated samples. However, manual annotation of gigapixel WSIs is labor-intensive and error-prone, i.e., the shortage of annotations has become the major bottleneck of WSI diagnosis model development. In this work, we aim to develop a deep learning based self-supervised histopathology image analysis workflow that can classify tissues without any annotation. Methods: Inspired by the contrastive learning methods that have achieved state-of-the-art results on unsupervised representation learning for natural images, we adopt the self-supervised training scheme to generate discriminative embeddings from annotation-free WSI patches and simultaneously obtain initial clusters, which are further refined by a silhouette coefficient based recursive scheme to divide tissue mixture clusters. A multi-scale encoder network is specifically designed to extract pathology-specific contextual features. A tissue dictionary composed by the tissue clusters is then built for cancer diagnosis. Results: Experiments show that our method can identify different tissues in annotation-free conditions with competitive results (achieving the accuracy of 0.9364/0.9325 in human colorectal/sentinel lymph WSIs) as the supervised methods (with the corresponding accuracy of 0.9806/0.9494) and surpass other unsupervised baselines. Our method is also evaluated in a cohort of 20 clinical patients and get an AUC score of 0.99 to distinguish benign/malignant polyps. Conclusion: Our proposed deep contrastive learning based tissue clustering method can learn from raw WSIs without annotation to distinguish different tissues. The method are tested in three different datasets and show the potential to help pathologists diagnosing diseases as a quantitative and qualitative tool.

Identify Representative Samples by Conditional Random Field of Cancer Histology Images

A Deformable CRF Model for Histopathology Whole-Slide Image Classification

Sampling Based Tumor Recognition in Whole-Slide Histology Image with Deep Learning Approaches.

Representative Region Based Active Learning for Histological Classification of Colorectal Cancer

Cancer Metastasis Detection With Neural Conditional Random Field

Accurate Pathological Patch Classification with Regression

Classification of Breast Cancer Histology Images Using Multi-Size and Discriminative Patches Based on Deep Learning.

Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classification

Deep contrastive learning based tissue clustering for annotation-free histopathology image analysis

Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction using Patch-based Graph Convolutional Networks

Multi-class Breast Tumor Region Detection for Gigapixel Pathology Images Using Deep Neural Network with Rescale Approach

Deep learning-based cross-classifications reveal conserved spatial behaviors within tumor histological images

Efficient Classification of Histopathology Images

A Hybrid Convolutional and Recurrent Deep Neural Network for Breast Cancer Pathological Image Classification

Context-aware stacked convolutional neural networks for classification of breast carcinomas in whole-slide histopathology images

Multi-Stain Multi-Level Convolutional Network for Multi-Tissue Breast Cancer Image Segmentation

A Deep Learning Approach for Tissue Spatial Quantification and Genomic Correlations of Histopathological Images

Cervical Histopathology Image Classification Using Multilayer Hidden Conditional Random Fields and Weakly Supervised Learning

Conditional Deep Convolutional Neural Networks for Improving the Automated Screening of Histopathological Images

Breast Cancer Microscope Image Classification Based On Cnn With Image Deformation

Direct Cellularity Estimation on Breast Cancer Histopathology Images Using Transfer Learning