Abstract:Background: Deep convolutional neural networks (CNNs) have yielded promising results in automatic whole slide images (WSIs) processing for digital pathology in recent years. Training supervised CNNs usually requires a large amount of annotated samples. However, manual annotation of gigapixel WSIs is labor-intensive and error-prone, i.e., the shortage of annotations has become the major bottleneck of WSI diagnosis model development. In this work, we aim to develop a deep learning based self-supervised histopathology image analysis workflow that can classify tissues without any annotation. Methods: Inspired by the contrastive learning methods that have achieved state-of-the-art results on unsupervised representation learning for natural images, we adopt the self-supervised training scheme to generate discriminative embeddings from annotation-free WSI patches and simultaneously obtain initial clusters, which are further refined by a silhouette coefficient based recursive scheme to divide tissue mixture clusters. A multi-scale encoder network is specifically designed to extract pathology-specific contextual features. A tissue dictionary composed by the tissue clusters is then built for cancer diagnosis. Results: Experiments show that our method can identify different tissues in annotation-free conditions with competitive results (achieving the accuracy of 0.9364/0.9325 in human colorectal/sentinel lymph WSIs) as the supervised methods (with the corresponding accuracy of 0.9806/0.9494) and surpass other unsupervised baselines. Our method is also evaluated in a cohort of 20 clinical patients and get an AUC score of 0.99 to distinguish benign/malignant polyps. Conclusion: Our proposed deep contrastive learning based tissue clustering method can learn from raw WSIs without annotation to distinguish different tissues. The method are tested in three different datasets and show the potential to help pathologists diagnosing diseases as a quantitative and qualitative tool.

Pathological Image Classification Based on Hard Example Guided CNN

Convolutional neural network classification of cancer cytopathology images: taking breast cancer as an example

Artificial Classification of Cervical Squamous Lesions in ThinPrep Cytologic Tests Using a Deep Convolutional Neural Network.

Breast cancer pathological image classification based on deep learning

Large Scale Tissue Histopathology Image Classification, Segmentation, and Visualization Via Deep Convolutional Activation Features

Histopathological Image Classification with Bilinear Convolutional Neural Networks

EENet : Application of convolutional neural network‐based deep learning methods in bone tumor pathological diagnosis

Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classification

Convolutional Neural Networks for Classifying Cervical Cancer Types Using Histological Images

Case-Based Histopathological Malignancy Diagnosis using Convolutional Neural Networks

Hierarchical Deep Convolutional Neural Networks for Multi-category Diagnosis of Gastrointestinal Disorders on Histopathological Images

Classification of Bone Tumor on CT Images Using Deep Convolutional Neural Network

Adaptive Threshold Learning in Frequency Domain for Classification of Breast Cancer Histopathological Images

Parallel Structure Deep Neural Network Using CNN and RNN with an Attention Mechanism for Breast Cancer Histology Image Classification

Classification of breast cancer histology images using Convolutional Neural Networks

Deep learning-based cross-classifications reveal conserved spatial behaviors within tumor histological images

BCCHI-HCNN: Breast Cancer Classification from Histopathological Images Using Hybrid Deep CNN Models

Multi-level features combined end-to-end learning for automated pathological grading of breast cancer on digital mammograms

Deep contrastive learning based tissue clustering for annotation-free histopathology image analysis

Imbalanced Histopathological Breast Cancer Image Classification with Convolutional Neural Network

Deep Learning for Histopathological Image Analysis: A Convolutional Neural Network Approach to Colon Cancer Classification