Abstract:Single cell segmentation is critical and challenging in live cell imaging data analysis. Traditional image processing methods and tools require time-consuming and labor-intensive efforts of manually fine-tuning parameters. Slight variations of image setting may lead to poor segmentation results. Recent development of deep convolutional neural networks(CNN) provides a potentially efficient, general and robust method for segmentation. Most existing CNN-based methods treat segmentation as a pixel-wise classification problem. However, three unique problems of cell images adversely affect segmentation accuracy: lack of established training dataset, few pixels on cell boundaries, and ubiquitous blurry features. The problem becomes especially severe with densely packed cells, where a pixel-wise classification method tends to identify two neighboring cells with blurry shared boundary as one cell, leading to poor cell count accuracy and affecting subsequent analysis. Here we developed a different learning strategy that combines strengths of CNN and watershed algorithm. The method first trains a CNN to learn Euclidean distance transform of binary masks corresponding to the input images. Then another CNN is trained to detect individual cells in the Euclidean distance transform. In the third step, the watershed algorithm takes the outputs from the previous steps as inputs and performs the segmentation. We tested the combined method and various forms of the pixel-wise classification algorithm on segmenting fluorescence and transmitted light images. The new method achieves similar pixel accuracy but significant higher cell count accuracy than pixel-wise classification methods do, and the advantage is most obvious when applying on noisy images of densely packed cells.

CNN-based Two-Stage Cell Segmentation Improves Plant Cell Tracking

Cell Tracking Across Noisy Image Sequences Via Faster R-CNN and Dynamic Local Graph Matching

Robust Plant Cell Tracking Using Local Spatio-Temporal Context

DeepSeed Local Graph Matching for Densely Packed Cells Tracking.

Joint Feature Learning for Cell Segmentation Based on Multi-scale Convolutional U-Net.

Learn to segment single cells with deep distance estimator and deep cell detector

Image Fusion Based Local Graph Matching for Plant Cell Tracking

A Multi-Seed 3D Local Graph Matching Model for Tracking of Densely Packed Cells.

A Multi-Seed Dynamic Local Graph Matching Model for Tracking of Densely Packed Cells Across Unregistered Microscopy Image Sequences

SC-Track: a robust cell tracking algorithm for generating accurate single-cell lineages from diverse cell segmentations

SC-Track: a robust cell-tracking algorithm for generating accurate single-cell lineages from diverse cell segmentations

Convolutional Features-Based CRF Graph Matching for Tracking of Densely Packed Cells.

Exploiting local structure for tracking plant cells in noisy images

Celltrack R-CNN: A Novel End-To-End Deep Neural Network for Cell Segmentation and Tracking in Microscopy Images

Plant Cell Tracking Using Kalman Filter Based Local Graph Matching

Robust Plant Cell Tracking in Noisy Image Sequences Using Optimal CRF Graph Matching

Compressive Tracking Moving Cells in Time-Lapse Image Sequences

Cell Population Tracking in a Honeycomb Structure Using an IMM Filter Based 3D Local Graph Matching Model

Automated Segmentation and Tracking of SAM Cells.

Cell Tracking Algorithm Based on Cellular Partition Combined with Multi-Frames and Original Images Feedback

Efficient Cell Segmentation And Tracking Of Developing Plant Meristem