Abstract:Digital pathology and microscopy image analysis are widely employed in the segmentation of digitally scanned IHC slides, primarily to identify cancer and pinpoint regions of interest (ROI) indicative of tumor presence. However, current ROI segmentation models are either stain-specific or suffer from the issues of stain and scanner variance due to different staining protocols or modalities across multiple labs. Also, tissues like Ductal Carcinoma in Situ (DCIS), acini, etc. are often classified as Tumors due to their structural similarities and color compositions. In this paper, we proposed a novel convolutional neural network (CNN) based Multi-class Tissue Segmentation model for histopathology whole-slide Breast slides which classify tumors and segments other tissue regions such as Ducts, acini, DCIS, Squamous epithelium, Blood Vessels, Necrosis, etc. as a separate class. Our unique pixel-aligned non-linear merge across spatial resolutions empowers models with both local and global fields of view for accurate detection of various classes. Our proposed model is also able to separate bad regions such as folds, artifacts, blurry regions, bubbles, etc. from tissue regions using multi-level context from different resolutions of WSI. Multi-phase iterative training with context-aware augmentation and increasing noise was used to efficiently train a multi-stain generic model with partial and noisy annotations from 513 slides. Our training pipeline used 12 million patches generated using context-aware augmentations which made our model stain and scanner invariant across data sources. To extrapolate stain and scanner invariance, our model was evaluated on 23000 patches which were for a completely new stain (Hematoxylin and Eosin) from a completely new scanner (Motic) from a different lab. The mean IOU was 0.72 which is on par with model performance on other data sources and scanners.

Breast Tumor Tissue Segmentation with Area-Based Annotation Using Convolutional Neural Network

Automatic segmentation and supervised learning-based selection of nuclei in cancer tissue images

Multi-Stain Multi-Level Convolutional Network for Multi-Tissue Breast Cancer Image Segmentation

Medical Breast Ultrasound Image Segmentation by Machine Learning

Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation

A review and comparison of breast tumor cell nuclei segmentation performances using deep convolutional neural networks

Breast tumor segmentation in ultrasound using distance-adapted fuzzy connectedness, convolutional neural network, and active contour

Automatic Tumor Segmentation in 3D Automated Breast Ultrasound Using Convolutional Neural Network

Seeing Beyond Cancer: Multi-Institutional Validation of Object Localization and 3D Semantic Segmentation using Deep Learning for Breast MRI

Automated post-operative brain tumour segmentation: A deep learning model based on transfer learning from pre-operative images

A color‐based tumor segmentation method for clinical ex vivo breast tissue assessment utilizing a multi‐contrast brightfield imaging strategy

Breast MRI Segmentation and Ki-67 High- and Low-Expression Prediction Algorithm Based on Deep Learning

Tumor segmentation in automated whole breast ultrasound using bidirectional LSTM neural network and attention mechanism

An Adaptive Region Growing Based on Neutrosophic Set in Ultrasound Domain for Image Segmentation

Image Segmentation of Triple-Negative Breast Cancer by Incorporating Multiscale and Parallel Attention Mechanisms

ACL-DUNet: A tumor segmentation method based on multiple attention and densely connected breast ultrasound images

Breast MRI Tumor Automatic Segmentation and Triple-Negative Breast Cancer Discrimination Algorithm Based on Deep Learning

Automatic Breast Tumor Detection in ABVS Images Based on Convolutional Neural Network and Superpixel Patterns

Breast Tumor Segmentation in Ultrasound Images Based on U-NET Model

Segmentation of gastric cancer from microscopic biopsy images using deep learning approach

BTS-ADCNN: brain tumor segmentation based on rapid anisotropic diffusion function combined with convolutional neural network using MR images