Abstract:Nuclear-derived morphological features and biomarkers provide relevant insights regarding the tumour microenvironment, while also allowing diagnosis and prognosis in specific cancer types. However, manually annotating nuclei from the gigapixel Haematoxylin and Eosin (H&E)-stained Whole Slide Images (WSIs) is a laborious and costly task, meaning automated algorithms for cell nuclei instance segmentation and classification could alleviate the workload of pathologists and clinical researchers and at the same time facilitate the automatic extraction of clinically interpretable features for artificial intelligence (AI) tools. But due to high intra- and inter-class variability of nuclei morphological and chromatic features, as well as H&E-stains susceptibility to artefacts, state-of-the-art algorithms cannot correctly detect and classify instances with the necessary performance. In this work, we hypothesize context and attention inductive biases in artificial neural networks (ANNs) could increase the performance and generalization of algorithms for cell nuclei instance segmentation and classification. To understand the advantages, use-cases, and limitations of context and attention-based mechanisms in instance segmentation and classification, we start by reviewing works in computer vision and medical imaging. We then conduct a thorough survey on context and attention methods for cell nuclei instance segmentation and classification from H&E-stained microscopy imaging, while providing a comprehensive discussion of the challenges being tackled with context and attention. Besides, we illustrate some limitations of current approaches and present ideas for future research. As a case study, we extend both a general (Mask-RCNN) and a customized (HoVer-Net) instance segmentation and classification methods with context- and attention-based mechanisms and perform a comparative analysis on a multicentre dataset for colon nuclei identification and counting. Although pathologists rely on context at multiple levels while paying attention to specific Regions of Interest (RoIs) when analysing and annotating WSIs, our findings suggest translating that domain knowledge into algorithm design is no trivial task, but to fully exploit these mechanisms in ANNs, the scientific understanding of these methods should first be addressed.

Nuclei & Glands Instance Segmentation in Histology Images: A Narrative Review

Nuclei and glands instance segmentation in histology images: a narrative review

A Comprehensive Overview of Computational Nuclei Segmentation Methods in Digital Pathology

Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential

A survey on cell nuclei instance segmentation and classification: Leveraging context and attention

A survey on recent trends in deep learning for nucleus segmentation from histopathology images

A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology

Nuclei Perception Network For Pathology Image Analysis

A three in one bottom-up framework for simultaneous semantic segmentation, instance segmentation and classification of multi-organ nuclei in digital cancer histology

Attention augmented distance regression and classification network for nuclei instance segmentation and type classification in histology images

Cellular Segmentation and Composition in Routine Histology Images using Deep Learning

Fuzzy Clustering and Active Contours for Histopathology Image Segmentation and Nuclei Detection

A Dual-Path Instance Segmentation Network Based on Nuclei Contour in Histology Image

Efficient Nucleus Detection in Digital Pathology Images Using Multi-task and Multi-scale Instance Segmentation Network

A robust automatic nuclei segmentation technique for quantitative histopathological image analysis.

MoNuSAC2020: A Multi-Organ Nuclei Segmentation and Classification Challenge

Accurate Segmentation of Nuclei in Pathological Images Via Sparse Reconstruction and Deep Convolutional Networks

Dataset of Segmented Nuclei in Hematoxylin and Eosin Stained Histopathology Images of 10 Cancer Types

NuInsSeg: A Fully Annotated Dataset for Nuclei Instance Segmentation in H&E-Stained Histological Images