Abstract:Single cell segmentation is critical and challenging in live cell imaging data analysis. Traditional image processing methods and tools require time-consuming and labor-intensive efforts of manually fine-tuning parameters. Slight variations of image setting may lead to poor segmentation results. Recent development of deep convolutional neural networks(CNN) provides a potentially efficient, general and robust method for segmentation. Most existing CNN-based methods treat segmentation as a pixel-wise classification problem. However, three unique problems of cell images adversely affect segmentation accuracy: lack of established training dataset, few pixels on cell boundaries, and ubiquitous blurry features. The problem becomes especially severe with densely packed cells, where a pixel-wise classification method tends to identify two neighboring cells with blurry shared boundary as one cell, leading to poor cell count accuracy and affecting subsequent analysis. Here we developed a different learning strategy that combines strengths of CNN and watershed algorithm. The method first trains a CNN to learn Euclidean distance transform of binary masks corresponding to the input images. Then another CNN is trained to detect individual cells in the Euclidean distance transform. In the third step, the watershed algorithm takes the outputs from the previous steps as inputs and performs the segmentation. We tested the combined method and various forms of the pixel-wise classification algorithm on segmenting fluorescence and transmitted light images. The new method achieves similar pixel accuracy but significant higher cell count accuracy than pixel-wise classification methods do, and the advantage is most obvious when applying on noisy images of densely packed cells.

Celltrack R-CNN: A Novel End-To-End Deep Neural Network for Cell Segmentation and Tracking in Microscopy Images

SC-Track: a robust cell tracking algorithm for generating accurate single-cell lineages from diverse cell segmentations

SC-Track: a robust cell-tracking algorithm for generating accurate single-cell lineages from diverse cell segmentations

Joint Feature Learning for Cell Segmentation Based on Multi-scale Convolutional U-Net.

Learn to segment single cells with deep distance estimator and deep cell detector

Scellseg: a Style-Aware Cell Instance Segmentation Tool with Pre-Training and Contrastive Fine-Tuning

Panoptic Segmentation with an End-to-End Cell R-CNN for Pathology Image Analysis

Tracking-Assisted Segmentation of Biological Cells

U-Net-based Deep Learning for Tracking and Quantitative Analysis of Intracellular Vesicles in Time-Lapse Microscopy Images

Cell Tracking via Proposal Generation and Selection

A novel deep learning-based 3D cell segmentation framework for future image-based disease detection

Graph Neural Network for Cell Tracking in Microscopy Videos

Fast 3D cell tracking with wide-field fluorescence microscopy through deep learning

EmbedTrack -- Simultaneous Cell Segmentation and Tracking Through Learning Offsets and Clustering Bandwidths

Training Convolutional Neural Networks and Compressed Sensing End-to-End for Microscopy Cell Detection

Deep Learning for Tracking of Intracellular Vesicles in Time-lapse Microscopy Images

Microscopy cell counting and detection with fully convolutional regression networks

pcnaDeep: A Fast and Robust Single-Cell Tracking Method Using Deep-Learning Mediated Cell Cycle Profiling

Advanced Multi-Microscopic Views Cell Semi-supervised Segmentation

Cell as Point: One-Stage Framework for Efficient Cell Tracking