Abstract:Developing computational pathology models is essential for reducing manual tissue typing from whole slide images, transferring knowledge from the source domain to an unlabeled, shifted target domain, and identifying unseen categories. We propose a practical setting by addressing the above-mentioned challenges in one fell swoop, i.e., source-free open-set domain adaptation. Our methodology focuses on adapting a pre-trained source model to an unlabeled target dataset and encompasses both closed-set and open-set classes. Beyond addressing the semantic shift of unknown classes, our framework also deals with a covariate shift, which manifests as variations in color appearance between source and target tissue samples. Our method hinges on distilling knowledge from a self-supervised vision transformer (ViT), drawing guidance from either robustly pre-trained transformer models or histopathology datasets, including those from the target domain. In pursuit of this, we introduce a novel style-based adversarial data augmentation, serving as hard positives for self-training a ViT, resulting in highly contextualized embeddings. Following this, we cluster semantically akin target images, with the source model offering weak pseudo-labels, albeit with uncertain confidence. To enhance this process, we present the closed-set affinity score (CSAS), aiming to correct the confidence levels of these pseudo-labels and to calculate weighted class prototypes within the contextualized embedding space. Our approach establishes itself as state-of-the-art across three public histopathological datasets for colorectal cancer assessment. Notably, our self-training method seamlessly integrates with open-set detection methods, resulting in enhanced performance in both closed-set and open-set recognition tasks.

Semi-Supervised Contrastive VAE for Disentanglement of Digital Pathology Images

Decomposing Disease Descriptions for Enhanced Pathology Detection: A Multi-Aspect Vision-Language Pre-training Framework

Disentangling Disease-related Representation from Obscure for Disease Prediction.

Depth disentanglement strategy of latent space for medical image segmentation

Double Attention for Pathology Image Diagnosis Network with Visual Interpretability.

A Pathology Image Diagnosis Network With Visual Interpretability And Structured Diagnostic Report

PA-LLaVA: A Large Language-Vision Assistant for Human Pathology Image Understanding

Contrastive Domain Disentanglement for Generalizable Medical Image Segmentation

LViT: Language meets Vision Transformer in Medical Image Segmentation

Orientation-Disentangled Unsupervised Representation Learning for Computational Pathology

Semi-supervised Pathology Segmentation with Disentangled Representations

Mutual Contrastive Learning to Disentangle Whole Slide Image Representations for Glioma Grading

SepVAE: a contrastive VAE to separate pathological patterns from healthy ones

Prediction of Tumor-Associated Macrophages and Immunotherapy Benefits Using Weakly Supervised Contrastive Learning in Breast Cancer Pathology Images

CDDSA: Contrastive domain disentanglement and style augmentation for generalizable medical image segmentation

Learning Group-Disentangled Representation for Interpretable Thoracic Pathologic Prediction.

SegTransVAE: Hybrid CNN -- Transformer with Regularization for medical image segmentation

Semi-supervised vision transformer with adaptive token sampling for breast cancer classification

Distill-SODA: Distilling Self-Supervised Vision Transformer for Source-Free Open-Set Domain Adaptation in Computational Pathology

SEDA: Self-Ensembling ViT with Defensive Distillation and Adversarial Training for robust Chest X-rays Classification