Abstract:Automated nucleus/cell detection is usually considered as the basis and a critical prerequisite step of computer assisted pathology and microscopy image analysis. However, due to the enormous variability (cell types, stains and different microscopes) and data complexity (cell overlapping, inhomogeneous intensities, background clutters and image artifacts), robust and accurate nucleus/cell detection is usually a difficult problem. To address this issue, we propose a novel multi-scale fully convolutional neural networks approach for regression of a density map to robustly detect the nuclei of pathology and microscopy images. The procedure can be divided into three main stages. Initially, instead of working on the simple dot label space, regression on the proposed structured proximity space for patches is performed so that centers of image patches are explicitly forced to produce larger values than their adjacent areas. Then, several multi-scale fully convolutional regression networks are developed for this task; this will enlarge the receptive field and not only can detect the single, small size cells, but also benefit to detecting cells with big size and overlapping states. In this stage, we copy the full feature maps from the contracting path and merge with the feature maps of the expansive path. This operation will make full use of shallow and deep semantic information of the networks. The networks do not have any fully connected layers; this strategy allows the seamless probability map prediction of arbitrarily large images. At the same time, data augmentations (e.g., small range shift, zoom and randomly flip) are carefully used to enhance the robustness of detection. Finally, morphological operations and suitable filters are employed and some prior information is introduced to find the centers of the cells more robustly. Our method achieves about 99.25% detection precision and the F1-measure is 0.9924 on fluorescence microscopy cell images; about 85.90% detection precision and the F1-measure is 0.9020 on Lymphocyte cell images and about 78.41% detection precision and the F1-measure is 0.8440 on breast histopathological images. This result leads to a promising detection performance that equates and sometimes exceeds the recently published leading detection approaches with the same benchmark datasets.

Learning unsupervised feature representations for single cell microscopy images with paired cell inpainting

Joint Feature Learning for Cell Segmentation Based on Multi-scale Convolutional U-Net.

Learning Consistent Subcellular Landmarks to Quantify Changes in Multiplexed Protein Maps.

Microscopy cell counting and detection with fully convolutional regression networks

Training Convolutional Neural Networks and Compressed Sensing End-to-End for Microscopy Cell Detection

Learning representations for image-based profiling of perturbations

Deep learning approach to Fourier ptychographic microscopy

Exploring the Deep Feature Space of a Cell Classification Neural Network

Classification and counting of cells in brightfield microscopy images: an application of convolutional neural networks

Grad-CAMO: Learning Interpretable Single-Cell Morphological Profiles from 3D Cell Painting Images

Cell Detection in Pathology and Microscopy Images with Multi-Scale Fully Convolutional Neural Networks

SubCell: Vision foundation models for microscopy capture single-cell biology

Learn to segment single cells with deep distance estimator and deep cell detector

An unsupervised deep learning framework encodes super-resolved image features to decode bacterial cell cycle

A Weakly Supervised Learning Method for Cell Detection and Tracking Using Incomplete Initial Annotations

Automated Counting of Cancer Cells by Ensembling Deep Features

Combining Deep Learning with Handcrafted Features for Cell Nuclei Segmentation

Semi-supervised variational autoencoder for cell feature extraction in multiplexed immunofluorescence images

Deep Learning Automates the Quantitative Analysis of Individual Cells in Live-Cell Imaging Experiments

Small hand-designed convolutional neural networks outperform transfer learning in automated cell shape detection in confluent tissues

Uncovering Interpretable Fine-Grained Phenotypes of Subcellular Dynamics through Unsupervised Self-Training of Deep Neural Networks