Abstract:Automated nucleus/cell detection is usually considered as the basis and a critical prerequisite step of computer assisted pathology and microscopy image analysis. However, due to the enormous variability (cell types, stains and different microscopes) and data complexity (cell overlapping, inhomogeneous intensities, background clutters and image artifacts), robust and accurate nucleus/cell detection is usually a difficult problem. To address this issue, we propose a novel multi-scale fully convolutional neural networks approach for regression of a density map to robustly detect the nuclei of pathology and microscopy images. The procedure can be divided into three main stages. Initially, instead of working on the simple dot label space, regression on the proposed structured proximity space for patches is performed so that centers of image patches are explicitly forced to produce larger values than their adjacent areas. Then, several multi-scale fully convolutional regression networks are developed for this task; this will enlarge the receptive field and not only can detect the single, small size cells, but also benefit to detecting cells with big size and overlapping states. In this stage, we copy the full feature maps from the contracting path and merge with the feature maps of the expansive path. This operation will make full use of shallow and deep semantic information of the networks. The networks do not have any fully connected layers; this strategy allows the seamless probability map prediction of arbitrarily large images. At the same time, data augmentations (e.g., small range shift, zoom and randomly flip) are carefully used to enhance the robustness of detection. Finally, morphological operations and suitable filters are employed and some prior information is introduced to find the centers of the cells more robustly. Our method achieves about 99.25% detection precision and the F1-measure is 0.9924 on fluorescence microscopy cell images; about 85.90% detection precision and the F1-measure is 0.9020 on Lymphocyte cell images and about 78.41% detection precision and the F1-measure is 0.8440 on breast histopathological images. This result leads to a promising detection performance that equates and sometimes exceeds the recently published leading detection approaches with the same benchmark datasets.

Small hand-designed convolutional neural networks outperform transfer learning in automated cell shape detection in confluent tissues

Cell dynamic morphology classification using deep convolutional neural networks.

Deep Learning Automates the Quantitative Analysis of Individual Cells in Live-Cell Imaging Experiments

Microscopy cell counting and detection with fully convolutional regression networks

Morphological signatures of actin organization in single cells accurately classify genetic perturbations using CNNs with transfer learning

Efficient and robust cell detection: A structured regression approach.

Highly accurate differentiation of bone marrow cell morphologies using deep neural networks on a large image data set

Training Convolutional Neural Networks and Compressed Sensing End-to-End for Microscopy Cell Detection

Cell Dynamic Morphology Analysis by Deep Convolutional Features

Cell Counting by Regression Using Convolutional Neural Network

Segmentation of histological images and fibrosis identification with a convolutional neural network

Cell Detection in Pathology and Microscopy Images with Multi-Scale Fully Convolutional Neural Networks

Learn to segment single cells with deep distance estimator and deep cell detector

Convolutional neural network for cell classification using microscope images of intracellular actin networks

Classification and counting of cells in brightfield microscopy images: an application of convolutional neural networks

Evaluation of deep learning training strategies for the classification of bone marrow cell images

Deep Mining of Subtle Differences in Cell Morphology Via Deep Learning

Deep learning of cell spatial organizations identifies clinically relevant insights in tissue images

Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning

Convolutional Neural Networks for Cellular Drug Response Prediction Using Immunofluorescence Images of Intracellular Actin Filament Networks