Abstract:Automated nucleus/cell detection is usually considered as the basis and a critical prerequisite step of computer assisted pathology and microscopy image analysis. However, due to the enormous variability (cell types, stains and different microscopes) and data complexity (cell overlapping, inhomogeneous intensities, background clutters and image artifacts), robust and accurate nucleus/cell detection is usually a difficult problem. To address this issue, we propose a novel multi-scale fully convolutional neural networks approach for regression of a density map to robustly detect the nuclei of pathology and microscopy images. The procedure can be divided into three main stages. Initially, instead of working on the simple dot label space, regression on the proposed structured proximity space for patches is performed so that centers of image patches are explicitly forced to produce larger values than their adjacent areas. Then, several multi-scale fully convolutional regression networks are developed for this task; this will enlarge the receptive field and not only can detect the single, small size cells, but also benefit to detecting cells with big size and overlapping states. In this stage, we copy the full feature maps from the contracting path and merge with the feature maps of the expansive path. This operation will make full use of shallow and deep semantic information of the networks. The networks do not have any fully connected layers; this strategy allows the seamless probability map prediction of arbitrarily large images. At the same time, data augmentations (e.g., small range shift, zoom and randomly flip) are carefully used to enhance the robustness of detection. Finally, morphological operations and suitable filters are employed and some prior information is introduced to find the centers of the cells more robustly. Our method achieves about 99.25% detection precision and the F1-measure is 0.9924 on fluorescence microscopy cell images; about 85.90% detection precision and the F1-measure is 0.9020 on Lymphocyte cell images and about 78.41% detection precision and the F1-measure is 0.8440 on breast histopathological images. This result leads to a promising detection performance that equates and sometimes exceeds the recently published leading detection approaches with the same benchmark datasets.

Joint Feature Learning for Cell Segmentation Based on Multi-scale Convolutional U-Net.

CellSegNet: an Adaptive Multi-Resolution Hybrid Network for Cell Segmentation

Microscopy Cell Segmentation Via Convolutional LSTM Networks

DeepSplit: Segmentation of Microscopy Images Using Multi-task Convolutional Networks

Joint Multi-frame Detection and Segmentation for Multi-cell Tracking

Learn to segment single cells with deep distance estimator and deep cell detector

Advanced Multi-Microscopic Views Cell Semi-supervised Segmentation

Multi-Path U-Net Architecture for Cell and Colony-Forming Unit Image Segmentation

Attention-Guided Residual U-Net with SE Connection and ASPP for Watershed-Based Cell Segmentation in Microscopy Images

Robust Segmentation Of Overlapping Cells In Cervical Cytology Using Light Convolution Neural Network

UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation

Deep Multi-Scale U-Net Architecture and Label-Noise Robust Training Strategies for Histopathological Image Segmentation

Cell Detection in Pathology and Microscopy Images with Multi-Scale Fully Convolutional Neural Networks

Dilated Heterogeneous Convolution for Cell Detection and Segmentation Based on Mask R-CNN

MTCSNet: One-stage Learning and Two-Point Labeling Are Sufficient for Cell Segmentation

MDU-Net: Multi-scale Densely Connected U-Net for biomedical image segmentation

Look in Different Views: Multi-Scheme Regression Guided Cell Instance Segmentation

Learning U-Net Based Multi-Scale Features in Encoding-Decoding for MR Image Brain Tissue Segmentation.

Enforcing Morphological Information in Fully Convolutional Networks to Improve Cell Instance Segmentation in Fluorescence Microscopy Images

DAN-NucNet: A Dual Attention Based Framework for Nuclei Segmentation in Cancer Histology Images under Wild Clinical Conditions

Point-supervised Single-cell Segmentation via Collaborative Knowledge Sharing