Abstract:Automated nucleus/cell detection is usually considered as the basis and a critical prerequisite step of computer assisted pathology and microscopy image analysis. However, due to the enormous variability (cell types, stains and different microscopes) and data complexity (cell overlapping, inhomogeneous intensities, background clutters and image artifacts), robust and accurate nucleus/cell detection is usually a difficult problem. To address this issue, we propose a novel multi-scale fully convolutional neural networks approach for regression of a density map to robustly detect the nuclei of pathology and microscopy images. The procedure can be divided into three main stages. Initially, instead of working on the simple dot label space, regression on the proposed structured proximity space for patches is performed so that centers of image patches are explicitly forced to produce larger values than their adjacent areas. Then, several multi-scale fully convolutional regression networks are developed for this task; this will enlarge the receptive field and not only can detect the single, small size cells, but also benefit to detecting cells with big size and overlapping states. In this stage, we copy the full feature maps from the contracting path and merge with the feature maps of the expansive path. This operation will make full use of shallow and deep semantic information of the networks. The networks do not have any fully connected layers; this strategy allows the seamless probability map prediction of arbitrarily large images. At the same time, data augmentations (e.g., small range shift, zoom and randomly flip) are carefully used to enhance the robustness of detection. Finally, morphological operations and suitable filters are employed and some prior information is introduced to find the centers of the cells more robustly. Our method achieves about 99.25% detection precision and the F1-measure is 0.9924 on fluorescence microscopy cell images; about 85.90% detection precision and the F1-measure is 0.9020 on Lymphocyte cell images and about 78.41% detection precision and the F1-measure is 0.8440 on breast histopathological images. This result leads to a promising detection performance that equates and sometimes exceeds the recently published leading detection approaches with the same benchmark datasets.

Multi-Class Cell Detection Using Spatial Context Representation

Context aware decision support in neurosurgical oncology based on an efficient classification of endomicroscopic data

Topology-Guided Multi-Class Cell Context Generation for Digital Pathology

Cell Detection in Pathology and Microscopy Images with Multi-Scale Fully Convolutional Neural Networks

Exploring Contextual Relationships for Cervical Abnormal Cell Detection

Capturing global spatial context for accurate cell classification in skin cancer histology

SAMCNet for Spatial-configuration-based Classification: A Summary of Results

Histopathological Image Classification with Cell Morphology Aware Deep Neural Networks

Multi-label Detection and Classification of Red Blood Cells in Microscopic Images

SpatialCells: automated profiling of tumor microenvironments with spatially resolved multiplexed single-cell data

Multi-scale and multi-context mapping of cell states across heterogenous spatial samples.

Spatial Omics Driven Crossmodal Pretraining Applied to Graph-based Deep Learning for Cancer Pathology Analysis

Robust Tumor Detection from Coarse Annotations via Multi-Magnification Ensembles

Multi-Class Multi-Scale Series Contextual Model for Image Segmentation

Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction using Patch-based Graph Convolutional Networks

Multiscale Detection of Cancerous Tissue in High Resolution Slide Scans

Single-Cell Spatial Analysis of Histopathology Images for Survival Prediction Via Graph Attention Network

Multi-class Breast Tumor Region Detection for Gigapixel Pathology Images Using Deep Neural Network with Rescale Approach

Auxiliary Classification of Cervical Cells Based on Multi-Domain Hybrid Deep Learning Framework

Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images

A Lightweight Spatially-Aware Classification Model for Breast Cancer Pathology Images