Abstract:Automated nucleus/cell detection is usually considered as the basis and a critical prerequisite step of computer assisted pathology and microscopy image analysis. However, due to the enormous variability (cell types, stains and different microscopes) and data complexity (cell overlapping, inhomogeneous intensities, background clutters and image artifacts), robust and accurate nucleus/cell detection is usually a difficult problem. To address this issue, we propose a novel multi-scale fully convolutional neural networks approach for regression of a density map to robustly detect the nuclei of pathology and microscopy images. The procedure can be divided into three main stages. Initially, instead of working on the simple dot label space, regression on the proposed structured proximity space for patches is performed so that centers of image patches are explicitly forced to produce larger values than their adjacent areas. Then, several multi-scale fully convolutional regression networks are developed for this task; this will enlarge the receptive field and not only can detect the single, small size cells, but also benefit to detecting cells with big size and overlapping states. In this stage, we copy the full feature maps from the contracting path and merge with the feature maps of the expansive path. This operation will make full use of shallow and deep semantic information of the networks. The networks do not have any fully connected layers; this strategy allows the seamless probability map prediction of arbitrarily large images. At the same time, data augmentations (e.g., small range shift, zoom and randomly flip) are carefully used to enhance the robustness of detection. Finally, morphological operations and suitable filters are employed and some prior information is introduced to find the centers of the cells more robustly. Our method achieves about 99.25% detection precision and the F1-measure is 0.9924 on fluorescence microscopy cell images; about 85.90% detection precision and the F1-measure is 0.9020 on Lymphocyte cell images and about 78.41% detection precision and the F1-measure is 0.8440 on breast histopathological images. This result leads to a promising detection performance that equates and sometimes exceeds the recently published leading detection approaches with the same benchmark datasets.

Microscopy cell counting and detection with fully convolutional regression networks

Cell Counting by Regression Using Convolutional Neural Network

Deeply-Supervised Density Regression for Automatic Cell Counting in Microscopy Images

Automatic microscopic cell counting by use of deeply-supervised density regression model

Classification Beats Regression: Counting of Cells from Greyscale Microscopic Images based on Annotation-free Training Samples

Classification and counting of cells in brightfield microscopy images: an application of convolutional neural networks

Cell Detection in Pathology and Microscopy Images with Multi-Scale Fully Convolutional Neural Networks

MSCA-UNet: Multi-Scale Convolutional Attention UNet for Automatic Cell Counting Using Density Regression.

Training Convolutional Neural Networks and Compressed Sensing End-to-End for Microscopy Cell Detection

Efficient and robust cell detection: A structured regression approach.

Detecting cells in intravital video microscopy using a deep convolutional neural network

Cells Counting with Convolutional Neural Network.

An Extended Type Cell Detection and Counting Method based on FCN

Learning unsupervised feature representations for single cell microscopy images with paired cell inpainting

Celltrack R-CNN: A Novel End-To-End Deep Neural Network for Cell Segmentation and Tracking in Microscopy Images

Automatic microscopic cell counting by use of unsupervised adversarial domain adaptation and supervised density regression

Cell Localization and Counting Using Direction Field Map

Automatic Cell Counting in Flourescent Microscopy Using Deep Learning

Counting Cells in Time-Lapse Microscopy using Deep Neural Networks

Automatic Detection of Circulating Tumor Cells with Very Deep Residual Networks

Using Deep Learning for Segmentation and Counting within Microscopy Data