Abstract:Background: Light microscopy is a widely used technique in cell biology due to its satisfactory resolution for cellular structure analysis, prevalent availability of fluorescent probes for staining, and compatibility for the dynamic analysis of live cells. However, the segmentation of cells and nuclei from microscopic images is not a straightforward process because it has several challenges such as high variation in morphology and shape, the presence of noise and diverse contrast in backgrounds, clustering or overlapping nature of cells. Dealing with these challenges and facilitating more reliable analysis necessitates the implementation of computer-aided methods that leverage image processing techniques and deep learning algorithms. The major goal of this study is to propose a model, for instance segmentation of cells and nuclei, applying the most cutting-edge deep learning techniques. Methods: A fine-tuned You Only Look at Once version 9 extended (YOLOv9-E) model is initially applied as a prompt generator to generate bounding box prompts. Using the generated prompts, a pre-trained segment anything model (SAM) is subsequently applied through zero-short inferencing to produce raw segmentation masks. These segmentation masks are then refined using non-max suppression and simple image processing methods such as image addition and morphological processing. The proposed method is developed and evaluated using an open-sourced dataset called Expert Visual Cell Annotation (EVICAN), which is relatively large and contains 4,738 microscopy images extracted from cross organs using different protocols. Results: Based on the evaluation results on three different levels of EVICAN test sets, the proposed method demonstrates noticeable performances showing average mAP50 [mean average precision at intersection over union (IoU) =0.50] scores of 96.25, 95.05, and 94.18 for cell segmentation, and 68.04, 54.66, and 38.29 for nucleus segmentation on easy, medium, and difficult test sets, respectively. Conclusions: Our proposed method for instance segmentation of cells and nuclei provided favorable performance compared to the existing methods in literature, indicating its potential utility as an assistive tool for cell culture experts, facilitating prompt and reliable analysis.

YOLO2U-Net: Detection-guided 3D instance segmentation for microscopy

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

Fast and Lightweight Network Improves Serial Brain Section Stitching

3D U$$^$$-Net: A 3D Universal U-Net for Multi-domain Medical Image Segmentation

Brain tumor detection and segmentation using deep learning

Attention 3D U-Net with Multiple Skip Connections for Segmentation of Brain Tumor Images

Identify and Segment Microalgae in Complex Backgrounds with Improved YOLO

Three-Dimensional Object Segmentation Method based on YOLO, SAM, and NeRF

A deep learning-based strategy for producing dense 3D segmentations from sparsely annotated 2D images

Open-YOLO 3D: Towards Fast and Accurate Open-Vocabulary 3D Instance Segmentation

Instance segmentation of cells and nuclei from multi-organ cross-protocol microscopic images

Automated Brain Tumor Segmentation and Classification in MRI Using YOLO-Based Deep Learning

Brain Cancer Segmentation Using YOLOv5 Deep Neural Network

Automated neuropil segmentation of fluorescent images for Drosophila brains

YOLO Object Detector and Inception-V3 Convolutional Neural Network for Improved Brain Tumor Segmentation

Automated Cell Structure Extraction for 3D Electron Microscopy by Deep Learning

A novel deep learning-based 3D cell segmentation framework for future image-based disease detection

A General Deep Learning framework for Neuron Instance Segmentation based on Efficient UNet and Morphological Post-processing

3-D RoI-Aware U-Net for Accurate and Efficient Colorectal Tumor Segmentation

YOLOMask, an Instance Segmentation Algorithm Based on Complementary Fusion Network

Sequential 3D U-Nets for Biologically-Informed Brain Tumor Segmentation