Abstract:Simultaneous nuclei segmentation and classification in digital histology play a fundamental role in diagnosing cancer. The segmentation and classification of nuclei in digital histology is challenging due to the higher morphological variability, staining variability, variability across the tissue, rough clinical conditions, and class imbalance. Recent deep learning methods have shown improved performance. However, these methods still have a considerable improvement gap, especially in complex situations. In our previous network, DANNucNet, we have resolved some of these issues using both channel and spatial attention mechanisms for semantic segmentation. In this work, we utilize our previous network to develop a mechanism, for instance, segmentation and classification, using a bottom-up approach. We propose a dual spatial-channel attention-based three head model, which produces semantic segmentation, edge maps, and classification maps. Then, like bottom-up approaches, we use edge maps and semantic segmentation to apply controlled watersheds to produce instance segmentation maps. Then using the instance segmentation maps, we further clean the classification maps using pixel grouping. The proposed method is tested on the recently released largest available dataset, PanNuke. We demonstrate a significant performance improvement in semantic segmentation, thus producing high-quality instance segmentation and nuclei classification compared to the state-of-the-art. We have achieved a 0.841 Dice score for semantic segmentation, 0.713 bPQ scores for instance segmentation, and 0.633 mPQ for nuclei classification. Our proposed framework is generalized across 19 different types of tissues. Furthermore, the framework is less complex compared to the state-of-the-art. The performance improvement and robustness of the proposed method will have positive implications on procedures requiring nuclei segmentation and classification.

Deep Learning architectures for generalized immunofluorescence based nuclear image segmentation

Evaluation Of Deep Learning Strategies For Nucleus Segmentation In Fluorescence Images

aiSEGcell: User-friendly deep learning-based segmentation of nuclei in transmitted light images

An annotated fluorescence image dataset for training nuclear segmentation methods

BriFiSeg: a deep learning-based method for semantic and instance segmentation of nuclei in brightfield images

Mutual-Complementing Framework for Nuclei Detection and Segmentation in Pathology Image

An Improved Nested U-Net Network for Fluorescence In Situ Hybridization Cell Image Segmentation

Regionally Adaptive Active Learning Framework for Nuclear Segmentation in Microscopy Image

NISNet3D: three-dimensional nuclear synthesis and instance segmentation for fluorescence microscopy images

An Integrative Segmentation Framework for Cell Nucleus of Fluorescence Microscopy

A General Deep Learning framework for Neuron Instance Segmentation based on Efficient UNet and Morphological Post-processing

A Deep Learning Framework for Nuclear Segmentation and Classification in Histopathological Images

Real-time and accurate deep learning-based multi-organ nucleus segmentation in histology images

Stable Deep Neural Network Architectures for Mitochondria Segmentation on Electron Microscopy Volumes

Semantic Segmentation of Cell Painted Organelles using DeepLabv3plus Model

An Automated Method with Anchor-Free Detection and U-shaped Segmentation for Nuclei Instance Segmentation.

A Segmentation Method for fluorescence images without a machine learning approach

Learn to segment single cells with deep distance estimator and deep cell detector

Analysis of the performance of U-Net neural networks for the segmentation of living cells

DAN-NucNet++: A Bottom-Up Framework Using Dual Attention Network for Simultaneous Nuclei Segmentation and Classification in Digital Histology Images

Investigating the Impact of the Bit Depth of Fluorescence-Stained Images on the Performance of Deep Learning-Based Nuclei Instance Segmentation