Abstract:We propose CellSAM, a robust model for cell segmentation in medical images using a dual‐image encoder and knowledge distillation. It achieves high accuracy with limited training data, showing promise for clinical applications in disease diagnosis and treatment. Segment anything model (SAM) has attracted extensive interest as a potent large‐scale image segmentation model, with prior efforts adapting it for use in medical imaging. However, the precise segmentation of cell nucleus instances remains a formidable challenge in computational pathology, given substantial morphological variations and the dense clustering of nuclei with unclear boundaries. This study presents an innovative cell segmentation algorithm named CellSAM. CellSAM has the potential to improve the effectiveness and precision of disease identification and therapy planning. As a variant of SAM, CellSAM integrates dual‐image encoders and employs techniques such as knowledge distillation and mask fusion. This innovative model exhibits promising capabilities in capturing intricate cell structures and ensuring adaptability in resource‐constrained scenarios. The experimental results indicate that this structure effectively enhances the quality and precision of cell segmentation. Remarkably, CellSAM demonstrates outstanding results even with minimal training data. In the evaluation of particular cell segmentation tasks, extensive comparative analyzes show that CellSAM outperforms both general fundamental models and state‐of‐the‐art (SOTA) task‐specific models. Comprehensive evaluation metrics yield scores of 0.884, 0.876, and 0.768 for mean accuracy, recall, and precision respectively. Extensive experiments show that CellSAM excels in capturing subtle details and complex structures and is capable of segmenting cells in images accurately. Additionally, CellSAM demonstrates excellent performance on clinical data, indicating its potential for robust applications in treatment planning and disease diagnosis, thereby further improving the efficiency of computer‐aided medicine.

Conceptualizing, Creating, & Controlling Constructive and Controversial Comments: A CSCW Research-athon

Evaluation Of Deep Learning Strategies For Nucleus Segmentation In Fluorescence Images

aiSEGcell: User-friendly deep learning-based segmentation of nuclei in transmitted light images

Efficient Multi-Organ Multi-Center Cell Nuclei Segmentation Method Based on Deep Learnable Aggregation Network

Enhancing Cell Instance Segmentation in Scanning Electron Microscopy Images via a Deep Contour Closing Operator

Real-time and accurate deep learning-based multi-organ nucleus segmentation in histology images

Defining the boundaries: challenges and advances in identifying cells in microscopy images

CellSAM: Advancing Pathologic Image Cell Segmentation via Asymmetric Large‐Scale Vision Model Feature Distillation Aggregation Network

Evaluation of Cellpose segmentation with sequential thresholding for instance segmentation of cytoplasms within autofluorescence images

CellSeg: a robust, pre-trained nucleus segmentation and pixel quantification software for highly multiplexed fluorescence images

Image Segmentation of the Cell Nuclei Staining Using U-net and Segment Anything Model

Semantic Segmentation of Cell Painted Organelles using DeepLabv3plus Model

The Multi-modality Cell Segmentation Challenge: Towards Universal Solutions

Saliency and boundary guided segmentation framework for cell counting in microscopy images

SegmentAnything helps microscopy images based automatic and quantitative organoid detection and analysis

User-Accessible Machine Learning Approaches for Cell Segmentation and Analysis in Tissue

BriFiSeg: a deep learning-based method for semantic and instance segmentation of nuclei in brightfield images

A systematic evaluation of computational methods for cell segmentation

Automated Cell Structure Extraction for 3D Electron Microscopy by Deep Learning

Practical Guidelines for Cell Segmentation Models Under Optical Aberrations in Microscopy