Abstract:Digital pathology and microscopy image analysis are widely employed in the segmentation of digitally scanned IHC slides, primarily to identify cancer and pinpoint regions of interest (ROI) indicative of tumor presence. However, current ROI segmentation models are either stain-specific or suffer from the issues of stain and scanner variance due to different staining protocols or modalities across multiple labs. Also, tissues like Ductal Carcinoma in Situ (DCIS), acini, etc. are often classified as Tumors due to their structural similarities and color compositions. In this paper, we proposed a novel convolutional neural network (CNN) based Multi-class Tissue Segmentation model for histopathology whole-slide Breast slides which classify tumors and segments other tissue regions such as Ducts, acini, DCIS, Squamous epithelium, Blood Vessels, Necrosis, etc. as a separate class. Our unique pixel-aligned non-linear merge across spatial resolutions empowers models with both local and global fields of view for accurate detection of various classes. Our proposed model is also able to separate bad regions such as folds, artifacts, blurry regions, bubbles, etc. from tissue regions using multi-level context from different resolutions of WSI. Multi-phase iterative training with context-aware augmentation and increasing noise was used to efficiently train a multi-stain generic model with partial and noisy annotations from 513 slides. Our training pipeline used 12 million patches generated using context-aware augmentations which made our model stain and scanner invariant across data sources. To extrapolate stain and scanner invariance, our model was evaluated on 23000 patches which were for a completely new stain (Hematoxylin and Eosin) from a completely new scanner (Motic) from a different lab. The mean IOU was 0.72 which is on par with model performance on other data sources and scanners.

Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classification

Context-aware stacked convolutional neural networks for classification of breast carcinomas in whole-slide histopathology images

Overcoming the limitations of patch-based learning to detect cancer in whole slide images

Tumor Detection for Whole Slide Image of Liver Based on Patch-Based Convolutional Neural Network

High-Resolution Histopathological Image Classification Model Based on Fused Heterogeneous Networks with Self-Supervised Feature Representation

Deep learning-based cross-classifications reveal conserved spatial behaviors within tumor histological images

Survival Prediction Based on Histopathology Imaging and Clinical Data: A Novel, Whole Slide CNN Approach

Sampling Based Tumor Recognition in Whole-Slide Histology Image with Deep Learning Approaches.

Whole Slide Image Multi-Classification of Cervical Epithelial Lesions Based on Unsupervised Pre-training

Rectified Cross-Entropy and Upper Transition Loss for Weakly Supervised Whole Slide Image Classifier.

EsccNet: A Hybrid CNN and Transformers Model for the Classification of Whole Slide Images of Esophageal Squamous Cell Carcinoma

Multi-Stain Multi-Level Convolutional Network for Multi-Tissue Breast Cancer Image Segmentation

Multi-Stage Pathological Image Classification using Semantic Segmentation

Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images

Convolutional neural network (CNN) classification of breast cancer in optical coherence tomography (OCT) images

Classification of Breast Cancer Histology Images Using Multi-Size and Discriminative Patches Based on Deep Learning.

Patient-level Microsatellite Stability Assessment from Whole Slide Images By Combining Momentum Contrast Learning and Group Patch Embeddings

Improving High Resolution Histology Image Classification with Deep Spatial Fusion Network

Automatic Whole Slide Pathology Image Diagnosis Framework Via Unit Stochastic Selection and Attention Fusion

Whole Slide Cervical Image Classification Based on Convolutional Neural Network and Random Forest

Convolutional neural network classification of cancer cytopathology images: taking breast cancer as an example