Abstract:Benefiting from the large-scale archiving of digitized whole-slide images (WSIs), computer-aided diagnosis has been well developed to assist pathologists in decision-making. Content-based WSI retrieval can be a new approach to find highly correlated WSIs in a historically diagnosed WSI archive, which has the potential usages for assisted clinical diagnosis, medical research, and trainee education. During WSI retrieval, it is particularly challenging to encode the semantic content of histopathological images and to measure the similarity between images for interpretable results due to the gigapixel size of WSIs. In this work, we propose a Retrieval with Clustering-guided Contrastive Learning (RetCCL) framework for robust and accurate WSI-level image retrieval, which integrates a novel self-supervised feature learning method and a global ranking and aggregation algorithm for much improved performance. The proposed feature learning method makes use of existing large-scale unlabeled histopathological image data, which helps learn universal features that could be used directly for subsequent WSI retrieval tasks without extra fine-tuning. The proposed WSI retrieval method not only returns a set of WSIs similar to a query WSI, but also highlights patches or sub-regions of each WSI that share high similarity with patches of the query WSI, which helps pathologists interpret the searching results. Our WSI retrieval framework has been evaluated on the tasks of anatomical site retrieval and cancer subtype retrieval using over 22,000 slides, and the performance exceeds other state-of-the-art methods significantly (around 10% for the anatomic site retrieval in terms of average mMV@10). Besides, the patch retrieval using our learned feature representation offers a performance improvement of 24% on the TissueNet dataset in terms of mMV@5 compared with using ImageNet pre-trained features, which further demonstrates the effectiveness of the proposed CCL feature learning method.

Complementation and recombination with temperature-sensitive mutants of adenovirus type 5.

Generative and Contrastive Based Self-Supervised Learning Model for Histopathology Image Analysis.

Contrastive learning-based computational histopathology predict differential expression of cancer driver genes

Contrastive learning-based histopathological features infer molecular subtypes and clinical outcomes of breast cancer from unannotated whole slide images

Pneumonia caused by Nocardia nova and Aspergillus fumigatus after cardiac transplantation.

Human-machine Interactive Tissue Prototype Learning for Label-efficient Histopathology Image Segmentation

Self-Distilled Supervised Contrastive Learning for diagnosis of breast cancers with histopathological images

RetCCL: Clustering-guided contrastive learning for whole-slide image retrieval

Whole Slide Image Multi-Classification of Cervical Epithelial Lesions Based on Unsupervised Pre-training

Lesion-Aware Contrastive Representation Learning for Histopathology Whole Slide Images Analysis

Mixed-function oxygenase enzymes as tools for pollution monitoring: field studies on the French coast of the Mediterranean Sea.

Predictable definitive impressions for multiple indirect restorations using a modified putty and wash impression procedure.

Data-efficient and weakly supervised computational pathology on whole-slide images

Histopathology Classification and Localization of Colorectal Cancer Using Global Labels by Weakly Supervised Deep Learning.

Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classification

Mine Local Homogeneous Representation by Interaction Information Clustering with Unsupervised Learning in Histopathology Images

Improving Performance in Colorectal Cancer Histology Decomposition using Deep and Ensemble Machine Learning

Context-Free Grammars, Differential Operators and Formal Power Series

Large Scale Tissue Histopathology Image Classification, Segmentation, and Visualization Via Deep Convolutional Activation Features

Weakly supervised pathological whole slide image classification based on contrastive learning

An unsupervised method for histological image segmentation based on tissue cluster level graph cut