Abstract:The automatic detection of cells in microscopy image sequences is a significant task in biomedical research. However, routine microscopy images with cells, which are taken during the process whereby constant division and differentiation occur, are notoriously difficult to detect due to changes in their appearance and number. Recently, convolutional neural network (CNN)-based methods have made significant progress in cell detection and tracking. However, these approaches require many manually annotated data for fully supervised training, which is time-consuming and often requires professional researchers. To alleviate such tiresome and labor-intensive costs, we propose a novel weakly supervised learning cell detection and tracking framework that trains the deep neural network using incomplete initial labels. Our approach uses incomplete cell markers obtained from fluorescent images for initial training on the Induced Pluripotent Stem (iPS) cell dataset, which is rarely studied for cell detection and tracking. During training, the incomplete initial labels were updated iteratively by combining detection and tracking results to obtain a model with better robustness. Our method was evaluated using two fields of the iPS cell dataset, along with the cell detection accuracy (DET) evaluation metric from the Cell Tracking Challenge (CTC) initiative, and it achieved 0.862 and 0.924 DET, respectively. The transferability of the developed model was tested using the public dataset FluoN2DH-GOWT1, which was taken from CTC; this contains two datasets with reference annotations. We randomly removed parts of the annotations in each labeled data to simulate the initial annotations on the public dataset. After training the model on the two datasets, with labels that comprise 10% cell markers, the DET improved from 0.130 to 0.903 and 0.116 to 0.877. When trained with labels that comprise 60% cell markers, the performance was better than the model trained using the supervised learning method. This outcome indicates that the model's performance improved as the quality of the labels used for training increased.

Attention-effective multiple instance learning on weakly stem cell colony segmentation

Transformer based multiple instance learning for weakly supervised histopathology image segmentation

Weakly supervised histopathology cancer image segmentation and classification

Context-constrained multiple instance learning for histopathology image segmentation.

Weakly supervised histopathology image segmentation with self-attention

Classifying and Segmenting Microscopy Images Using Convolutional Multiple Instance Learning

A Regional Multiple Instance Learning Network for Whole Slide Image Segmentation

WSM-MIL: A Weakly Supervised Segmentation Method with Multiple Instance Learning for C. Elegans Image

Quality evaluation of induced pluripotent stem cell colonies by fusing multi-source features

Contexts-Constrained Multiple Instance Learning for Histopathology Image Analysis

IIB-MIL: Integrated Instance-Level and Bag-Level Multiple Instances Learning with Label Disambiguation for Pathological Image Analysis

Deep-learning-based multi-class segmentation for automated, non-invasive routine assessment of human pluripotent stem cell culture status

A universal multiple instance learning framework for whole slide image analysis

Weakly Supervised Minirhizotron Image Segmentation with MIL-CAM

A Weakly Supervised Learning Method for Cell Detection and Tracking Using Incomplete Initial Annotations

Hybrid multiple instance learning network for weakly supervised medical image classification and localization

Deep Multiple Instance Learning for Automatic Detection of Diabetic Retinopathy in Retinal Images

Iterative multiple instance learning for weakly annotated whole slide image classification

Cell segmentation for immunofluorescence multiplexed images using two-stage domain adaptation and weakly labeled data for pre-training

TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification

Efficient online surface defect detection using multiple instance learning