Abstract:Background: Light microscopy is a widely used technique in cell biology due to its satisfactory resolution for cellular structure analysis, prevalent availability of fluorescent probes for staining, and compatibility for the dynamic analysis of live cells. However, the segmentation of cells and nuclei from microscopic images is not a straightforward process because it has several challenges such as high variation in morphology and shape, the presence of noise and diverse contrast in backgrounds, clustering or overlapping nature of cells. Dealing with these challenges and facilitating more reliable analysis necessitates the implementation of computer-aided methods that leverage image processing techniques and deep learning algorithms. The major goal of this study is to propose a model, for instance segmentation of cells and nuclei, applying the most cutting-edge deep learning techniques. Methods: A fine-tuned You Only Look at Once version 9 extended (YOLOv9-E) model is initially applied as a prompt generator to generate bounding box prompts. Using the generated prompts, a pre-trained segment anything model (SAM) is subsequently applied through zero-short inferencing to produce raw segmentation masks. These segmentation masks are then refined using non-max suppression and simple image processing methods such as image addition and morphological processing. The proposed method is developed and evaluated using an open-sourced dataset called Expert Visual Cell Annotation (EVICAN), which is relatively large and contains 4,738 microscopy images extracted from cross organs using different protocols. Results: Based on the evaluation results on three different levels of EVICAN test sets, the proposed method demonstrates noticeable performances showing average mAP50 [mean average precision at intersection over union (IoU) =0.50] scores of 96.25, 95.05, and 94.18 for cell segmentation, and 68.04, 54.66, and 38.29 for nucleus segmentation on easy, medium, and difficult test sets, respectively. Conclusions: Our proposed method for instance segmentation of cells and nuclei provided favorable performance compared to the existing methods in literature, indicating its potential utility as an assistive tool for cell culture experts, facilitating prompt and reliable analysis.

Cytoplasm Image Classification Based on Kolmogorov Complexity.

A Consolidated Approach to Convolutional Neural Networks and the Kolmogorov Complexity

An Unsupervised Approach for Overlapping Cervical Cell Cytoplasm Segmentation

Cell Image Classification: A Comparative Overview

An Energy Conduction Model for Cell Image Segmentation

Unsupervised Segmentation of Overlapping Cervical Cell Cytoplasm

A Fuzzy Segmentation Method to Learn Classification of Mitosis

Image3C, a multimodal image-based and label-independent integrative method for single-cell analysis

Cell State Recognition of Cytopathic Effect with YOLO Detector

Evaluation of Cellpose segmentation with sequential thresholding for instance segmentation of cytoplasms within autofluorescence images

IMCellXMBD: A Statistical Approach for Robust Cell Identification and Quantification from Imaging Mass Cytometry Images

Instance segmentation of cells and nuclei from multi-organ cross-protocol microscopic images

A Computational Approach to Detect and Segment Cytoplasm in Muscle Fiber Images

C1M2: a universal algorithm for 3D instance segmentation, annotation, and quantification of irregular cells

CellSeg: a robust, pre-trained nucleus segmentation and pixel quantification software for highly multiplexed fluorescence images

Unsupervised cervical cell instance segmentation method integrating cellular characteristics

A Method of Automatic Cell Counting Based on Microscopic Image

Robust Segmentation of Cell Nuclei in 3-D Microscopy Images

aiSEGcell: User-friendly deep learning-based segmentation of nuclei in transmitted light images

Separable-HoverNet and Instance-YOLO for Colon Nuclei Identification and Counting