Abstract:Benefiting from the large-scale archiving of digitized whole-slide images (WSIs), computer-aided diagnosis has been well developed to assist pathologists in decision-making. Content-based WSI retrieval can be a new approach to find highly correlated WSIs in a historically diagnosed WSI archive, which has the potential usages for assisted clinical diagnosis, medical research, and trainee education. During WSI retrieval, it is particularly challenging to encode the semantic content of histopathological images and to measure the similarity between images for interpretable results due to the gigapixel size of WSIs. In this work, we propose a Retrieval with Clustering-guided Contrastive Learning (RetCCL) framework for robust and accurate WSI-level image retrieval, which integrates a novel self-supervised feature learning method and a global ranking and aggregation algorithm for much improved performance. The proposed feature learning method makes use of existing large-scale unlabeled histopathological image data, which helps learn universal features that could be used directly for subsequent WSI retrieval tasks without extra fine-tuning. The proposed WSI retrieval method not only returns a set of WSIs similar to a query WSI, but also highlights patches or sub-regions of each WSI that share high similarity with patches of the query WSI, which helps pathologists interpret the searching results. Our WSI retrieval framework has been evaluated on the tasks of anatomical site retrieval and cancer subtype retrieval using over 22,000 slides, and the performance exceeds other state-of-the-art methods significantly (around 10% for the anatomic site retrieval in terms of average mMV@10). Besides, the patch retrieval using our learned feature representation offers a performance improvement of 24% on the TissueNet dataset in terms of mMV@5 compared with using ImageNet pre-trained features, which further demonstrates the effectiveness of the proposed CCL feature learning method.

Generating Region Proposals for Histopathological Whole Slide Image Retrieval

Generating Hypergraph-Based High-Order Representations of Whole-Slide Histopathological Images for Survival Prediction

Encoding histopathology whole slide images with location-aware graphs for diagnostically relevant regions retrieval

Histopathology language-image representation learning for fine-grained digital pathology cross-modal retrieval

RetCCL: Clustering-guided contrastive learning for whole-slide image retrieval

A multi-resolution model for histopathology image classification and localization with multiple instance learning

Representative Region Based Active Learning for Histological Classification of Colorectal Cancer

An attention-based multi-resolution model for prostate whole slide imageclassification and localization

Analysis and Validation of Image Search Engines in Histopathology

Cervical Nuclei Segmentation in Whole Slide Histopathology Images Using Convolution Neural Network

High-Order Correlation-Guided Slide-Level Histology Retrieval with Self-Supervised Hashing.

HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interaction

Supervised Graph Hashing for Histopathology Image Retrieval and Classification

Region of Interest Detection in Melanocytic Skin Tumor Whole Slide Images -- Nevus & Melanoma

Lifelong Histopathology Whole Slide Image Retrieval via Distance Consistency Rehearsal

A novel deep learning-based algorithm combining histopathological features with tissue areas to predict colorectal cancer survival from whole-slide images

Zero-Shot Whole Slide Image Retrieval in Histopathology Using Embeddings of Foundation Models

Densely-Connected Multi-Magnification Hashing for Histopathological Image Retrieval.

Region of Interest Detection in Melanocytic Skin Tumor Whole Slide Images-Nevus and Melanoma

Hierarchical Attention Guided Framework for Multi-resolution Collaborative Whole Slide Image Segmentation

Model-Agnostic Binary Patch Grouping for Bone Marrow Whole Slide Image Representation