Abstract:A large-scale and well-annotated dataset is a key factor for the success of deep learning in medical image analysis. However, assembling such large annotations is very challenging, especially for histopathological images with unique characteristics (e.g., gigapixel image size, multiple cancer types, and wide staining variations). To alleviate this issue, self-supervised learning (SSL) could be a promising solution that relies only on unlabeled data to generate informative representations and generalizes well to various downstream tasks even with limited annotations. In this work, we propose a novel SSL strategy called semantically-relevant contrastive learning (SRCL), which compares relevance between instances to mine more positive pairs. Compared to the two views from an instance in traditional contrastive learning, our SRCL aligns multiple positive instances with similar visual concepts, which increases the diversity of positives and then results in more informative representations. We employ a hybrid model ( CTransPath ) as the backbone, which is designed by integrating a convolutional neural network (CNN) and a multi-scale Swin Transformer architecture. The CTransPath is pretrained on massively unlabeled histopathological images that could serve as a collaborative local–global feature extractor to learn universal feature representations more suitable for tasks in the histopathology image domain. The effectiveness of our SRCL-pretrained CTransPath is investigated on five types of downstream tasks (patch retrieval, patch classification, weakly-supervised whole-slide image classification, mitosis detection, and colorectal adenocarcinoma gland segmentation), covering nine public datasets. The results show that our SRCL-based visual representations not only achieve state-of-the-art performance in each dataset, but are also more robust and transferable than other SSL methods and ImageNet pretraining (both supervised and self-supervised methods). Our code and pretrained model are available at https://github.com/Xiyue-Wang/TransPath.

Self-supervised Visual Representation Learning for Histopathological Images

HistoSSL: Self-Supervised Representation Learning for Classifying Histopathology Images

Generative and Contrastive Based Self-Supervised Learning Model for Histopathology Image Analysis.

Transformer-based unsupervised contrastive learning for histopathological image classification

Stain-Adaptive Self-Supervised Learning for Histopathology Image Analysis

Data Efficient Contrastive Learning in Histopathology using Active Sampling

Lesion-Aware Contrastive Representation Learning for Histopathology Whole Slide Images Analysis

Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotations

Efficient Self-Supervision using Patch-based Contrastive Learning for Histopathology Image Segmentation

Multi-resolution Consistency Semi-Supervised Active Learning Framework for Histopathology Image Classification

Self-Supervised Digital Histopathology Image Disentanglement for Arbitrary Domain Stain Transfer.

Domain-specific Knowledge Guided Self-supervised Learning for Pathological Image Segmentation.

Virtual Immunohistochemistry Staining for Histological Images Assisted by Weakly-supervised Learning

SRA: A Novel Method to Improve Feature Embedding in Self-supervised Learning for Histopathological Images

Graph temporal ensembling based semi-supervised convolutional neural network with noisy labels for histopathology image analysis

A semi-supervised learning approach with consistency regularization for tumor histopathological images analysis

GenSelfDiff-HIS: Generative Self-Supervision Using Diffusion for Histopathological Image Segmentation

HistoSegResT: A Weakly Supervised Learning Method for Histopathology Image Segmentation.

Self-Contrastive Weakly Supervised Learning Framework for Prognostic Prediction Using Whole Slide Images

Unpaired Stain Transfer Using Pathology-Consistent Constrained Generative Adversarial Networks

Deep contrastive learning based tissue clustering for annotation-free histopathology image analysis