Abstract:Quantitative analysis of cell nuclei in microscopic images is an essential yet challenging source of biological and pathological information. The major challenge is accurate detection and segmentation of densely packed nuclei in images acquired under a variety of conditions. Mask R-CNN-based methods have achieved state-of-the-art nucleus segmentation. However, the current pipeline requires fully annotated training images, which are time consuming to create and sometimes noisy. Importantly, nuclei often appear similar within the same image. This similarity could be utilized to segment nuclei with only partially labeled training examples. We propose a simple yet effective region-proposal module for the current Mask R-CNN pipeline to perform few-exemplar learning. To capture the similarities between unlabeled regions and labeled nuclei, we apply decomposed self-attention to learned features. On the self-attention map, we observe strong activation at the centers and edges of all nuclei, including unlabeled nuclei. On this basis, our region-proposal module propagates partial annotations to the whole image and proposes effective bounding boxes for the bounding box-regression and binary mask-generation modules. Our method effectively learns from unlabeled regions thereby improving detection performance. We test our method with various nuclear images. When trained with only 1/4 of the nuclei annotated, our approach retains a detection accuracy comparable to that from training with fully annotated data. Moreover, our method can serve as a bootstrapping step to create full annotations of datasets, iteratively generating and correcting annotations until a predetermined coverage and accuracy are reached. The source code is available at <a class="link-external link-https" href="https://github.com/feng-lab/nuclei" rel="external noopener nofollow">this https URL</a>.

Which Pixel to Annotate: A Label-Efficient Nuclei Segmentation Framework

Mutual-Complementing Framework for Nuclei Detection and Segmentation in Pathology Image

Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images

Few-Shot Learning for Annotation-Efficient Nucleus Instance Segmentation

Label Propagation for Annotation-Efficient Nuclei Segmentation from Pathology Images

Style Consistent Image Generation for Nuclei Instance Segmentation

A Light-Weight Interpretable Model for Nuclei Detection and Weakly-Supervised Segmentation

Semi-supervised nuclei segmentation based on multi-edge features fusion attention network

A Weakly Supervised Method with Colorization for Nuclei Segmentation Using Point Annotations.

Generative Adversarial Training for Weakly Supervised Nuclei Instance Segmentation

Efficient Nuclei Semantic Segmentation in Histopathology Images: A Weakly Supervised Approach with Color and Sure-Foreground Extraction

EOFD-Net: Edge Optimization and Feature Denoising for Weakly Supervised Deep Nuclei Segmentation with Point Annotations.

Label-Free Nuclei Segmentation Using Intra-Image Self Similarity

Robust Nucleus Detection with Partially Labeled Exemplars

A Light-weight Interpretable Compositional Model for Nuclei Detection and Weakly-Supervised Segmentation

EnNuSegNet: Enhancing Weakly Supervised Nucleus Segmentation through Feature Preservation and Edge Refinement

Instance-aware Self-supervised Learning for Nuclei Segmentation

Nuclei Segmentation with Point Annotations from Pathology Images via Self-Supervised Learning and Co-Training

Nucleus image segmentation method based on GAN and FCN model

Dynamic Pseudo Label Optimization in Point-Supervised Nuclei Segmentation

Deep Adversarial Image Synthesis for Nuclei Segmentation of Histopathology Image