Abstract:Digital pathology and microscopy image analysis are widely employed in the segmentation of digitally scanned IHC slides, primarily to identify cancer and pinpoint regions of interest (ROI) indicative of tumor presence. However, current ROI segmentation models are either stain-specific or suffer from the issues of stain and scanner variance due to different staining protocols or modalities across multiple labs. Also, tissues like Ductal Carcinoma in Situ (DCIS), acini, etc. are often classified as Tumors due to their structural similarities and color compositions. In this paper, we proposed a novel convolutional neural network (CNN) based Multi-class Tissue Segmentation model for histopathology whole-slide Breast slides which classify tumors and segments other tissue regions such as Ducts, acini, DCIS, Squamous epithelium, Blood Vessels, Necrosis, etc. as a separate class. Our unique pixel-aligned non-linear merge across spatial resolutions empowers models with both local and global fields of view for accurate detection of various classes. Our proposed model is also able to separate bad regions such as folds, artifacts, blurry regions, bubbles, etc. from tissue regions using multi-level context from different resolutions of WSI. Multi-phase iterative training with context-aware augmentation and increasing noise was used to efficiently train a multi-stain generic model with partial and noisy annotations from 513 slides. Our training pipeline used 12 million patches generated using context-aware augmentations which made our model stain and scanner invariant across data sources. To extrapolate stain and scanner invariance, our model was evaluated on 23000 patches which were for a completely new stain (Hematoxylin and Eosin) from a completely new scanner (Motic) from a different lab. The mean IOU was 0.72 which is on par with model performance on other data sources and scanners.

Multi-modal Denoising Diffusion Pre-training for Whole-Slide Image Classification

Enhancing Whole Slide Image Classification with Discriminative and Contrastive Learning

Dual-Attention Multiple Instance Learning Framework for Pathology Whole-Slide Image Classification

Multistain Pretraining for Slide Representation Learning in Pathology

The Whole Pathological Slide Classification via Weakly Supervised Learning

Multi-Cohort Framework with Cohort-Aware Attention and Adversarial Mutual-Information Minimization for Whole Slide Image Classification

Semantic-Similarity Collaborative Knowledge Distillation Framework for Whole Slide Image Classification

DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classification

Multi-scale representation attention based deep multiple instance learning for gigapixel whole slide image analysis

TDT-MIL: a framework with a dual-channel spatial positional encoder for weakly-supervised whole slide image classification

PreMix: Boosting Multiple Instance Learning in Digital Histopathology through Pre-training with Intra-Batch Slide Mixing

A universal multiple instance learning framework for whole slide image analysis

Dual Attention Model with Reinforcement Learning for Classification of Histology Whole-Slide Images

Multi-Stain Multi-Level Convolutional Network for Multi-Tissue Breast Cancer Image Segmentation

RoFormer for Position Aware Multiple Instance Learning in Whole Slide Image Classification

Cluster-to-Conquer: A Framework for End-to-End Multi-Instance Learning for Whole Slide Image Classification

Multiple Instance Learning Framework with Masked Hard Instance Mining for Whole Slide Image Classification

PathM3: A Multimodal Multi-Task Multiple Instance Learning Framework for Whole Slide Image Classification and Captioning

Exploring Visual Prompts for Whole Slide Image Classification with Multiple Instance Learning

PathoDuet: Foundation Models for Pathological Slide Analysis of H&E and IHC Stains

Slide-based Graph Collaborative Training for Histopathology Whole Slide Image Analysis