Abstract:We propose CellSAM, a robust model for cell segmentation in medical images using a dual‐image encoder and knowledge distillation. It achieves high accuracy with limited training data, showing promise for clinical applications in disease diagnosis and treatment. Segment anything model (SAM) has attracted extensive interest as a potent large‐scale image segmentation model, with prior efforts adapting it for use in medical imaging. However, the precise segmentation of cell nucleus instances remains a formidable challenge in computational pathology, given substantial morphological variations and the dense clustering of nuclei with unclear boundaries. This study presents an innovative cell segmentation algorithm named CellSAM. CellSAM has the potential to improve the effectiveness and precision of disease identification and therapy planning. As a variant of SAM, CellSAM integrates dual‐image encoders and employs techniques such as knowledge distillation and mask fusion. This innovative model exhibits promising capabilities in capturing intricate cell structures and ensuring adaptability in resource‐constrained scenarios. The experimental results indicate that this structure effectively enhances the quality and precision of cell segmentation. Remarkably, CellSAM demonstrates outstanding results even with minimal training data. In the evaluation of particular cell segmentation tasks, extensive comparative analyzes show that CellSAM outperforms both general fundamental models and state‐of‐the‐art (SOTA) task‐specific models. Comprehensive evaluation metrics yield scores of 0.884, 0.876, and 0.768 for mean accuracy, recall, and precision respectively. Extensive experiments show that CellSAM excels in capturing subtle details and complex structures and is capable of segmenting cells in images accurately. Additionally, CellSAM demonstrates excellent performance on clinical data, indicating its potential for robust applications in treatment planning and disease diagnosis, thereby further improving the efficiency of computer‐aided medicine.

Improved senescent cell segmentation on bright‐field microscopy images exploiting representation level contrastive learning

Morphology-based deep learning enables accurate detection of senescence in mesenchymal stem cell cultures

Deep learning based semantic segmentation and quantification for MRD biochip images

Saliency and boundary guided segmentation framework for cell counting in microscopy images

Advanced Multi-Microscopic Views Cell Semi-supervised Segmentation

Scellseg: a Style-Aware Cell Instance Segmentation Tool with Pre-Training and Contrastive Fine-Tuning

Automated mesenchymal stem cell segmentation and machine learning-based phenotype classification using morphometric and textural analysis

Identification of senescent cells in multipotent mesenchymal stromal cell cultures: Current methods and future directions

Efficient end-to-end learning for cell segmentation with machine generated weak annotations

Visual Prompting Based Incremental Learning for Semantic Segmentation of Multiplex Immuno-Flourescence Microscopy Imagery

High throughput screening of mesenchymal stem cell lines using deep learning

MultiHeadGAN: A deep learning method for low contrast retinal pigment epithelium cell segmentation with fluorescent flatmount microscopy images

Learn to segment single cells with deep distance estimator and deep cell detector

Enhancing Cell Instance Segmentation in Scanning Electron Microscopy Images via a Deep Contour Closing Operator

A Self-Supervised Learning Approach for High Throughput and High Content Cell Segmentation

CellSAM: Advancing Pathologic Image Cell Segmentation via Asymmetric Large‐Scale Vision Model Feature Distillation Aggregation Network

Automatic Cell Counting in Flourescent Microscopy Using Deep Learning

Machine learning aided single cell image analysis improves understanding of morphometric heterogeneity of human mesenchymal stem cells

Attention-Guided Residual U-Net with SE Connection and ASPP for Watershed-Based Cell Segmentation in Microscopy Images

Segmentation of Cellular Patterns in Confocal Images of Melanocytic Lesions in vivo via a Multiscale Encoder-Decoder Network (MED-Net)