Abstract:The automatic detection of cells in microscopy image sequences is a significant task in biomedical research. However, routine microscopy images with cells, which are taken during the process whereby constant division and differentiation occur, are notoriously difficult to detect due to changes in their appearance and number. Recently, convolutional neural network (CNN)-based methods have made significant progress in cell detection and tracking. However, these approaches require many manually annotated data for fully supervised training, which is time-consuming and often requires professional researchers. To alleviate such tiresome and labor-intensive costs, we propose a novel weakly supervised learning cell detection and tracking framework that trains the deep neural network using incomplete initial labels. Our approach uses incomplete cell markers obtained from fluorescent images for initial training on the Induced Pluripotent Stem (iPS) cell dataset, which is rarely studied for cell detection and tracking. During training, the incomplete initial labels were updated iteratively by combining detection and tracking results to obtain a model with better robustness. Our method was evaluated using two fields of the iPS cell dataset, along with the cell detection accuracy (DET) evaluation metric from the Cell Tracking Challenge (CTC) initiative, and it achieved 0.862 and 0.924 DET, respectively. The transferability of the developed model was tested using the public dataset FluoN2DH-GOWT1, which was taken from CTC; this contains two datasets with reference annotations. We randomly removed parts of the annotations in each labeled data to simulate the initial annotations on the public dataset. After training the model on the two datasets, with labels that comprise 10% cell markers, the DET improved from 0.130 to 0.903 and 0.116 to 0.877. When trained with labels that comprise 60% cell markers, the performance was better than the model trained using the supervised learning method. This outcome indicates that the model's performance improved as the quality of the labels used for training increased.

Efficient end-to-end learning for cell segmentation with machine generated weak annotations

A Weakly Supervised Learning Method for Cell Detection and Tracking Using Incomplete Initial Annotations

Point-supervised Single-cell Segmentation via Collaborative Knowledge Sharing

Scellseg: a Style-Aware Cell Instance Segmentation Tool with Pre-Training and Contrastive Fine-Tuning

Advanced Multi-Microscopic Views Cell Semi-supervised Segmentation

MTCSNet: One-stage Learning and Two-Point Labeling Are Sufficient for Cell Segmentation

Weakly Supervised Cell Instance Segmentation by Propagating from Detection Response

Training deep learning models for cell image segmentation with sparse annotations

The Contrastive Network with Convolution and Self-Attention Mechanisms for Unsupervised Cell Segmentation.

Knowing What to Label for Few Shot Microscopy Image Cell Segmentation

Learn to segment single cells with deep distance estimator and deep cell detector

Weakly-Supervised Cross-Domain Segmentation of Electron Microscopy with Sparse Point Annotation

Leveraging Weak Supervision for Cell Localization in Digital Pathology Using Multitask Learning and Consistency Loss

Saliency and boundary guided segmentation framework for cell counting in microscopy images

Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learning

Cell segmentation without annotation by unsupervised domain adaptation based on cooperative self-learning

Evaluation of semi-supervised learning using sparse labeling to segment cell nuclei

Leverage Weakly Annotation to Pixel-wise Annotation via Zero-shot Segment Anything Model for Molecular-empowered Learning

Semi-Supervised Neuron Segmentation via Reinforced Consistency Learning

Scribble2Label: Scribble-Supervised Cell Segmentation via Self-Generating Pseudo-Labels with Consistency

Cell segmentation for immunofluorescence multiplexed images using two-stage domain adaptation and weakly labeled data for pre-training