Abstract:We propose CellSAM, a robust model for cell segmentation in medical images using a dual‐image encoder and knowledge distillation. It achieves high accuracy with limited training data, showing promise for clinical applications in disease diagnosis and treatment. Segment anything model (SAM) has attracted extensive interest as a potent large‐scale image segmentation model, with prior efforts adapting it for use in medical imaging. However, the precise segmentation of cell nucleus instances remains a formidable challenge in computational pathology, given substantial morphological variations and the dense clustering of nuclei with unclear boundaries. This study presents an innovative cell segmentation algorithm named CellSAM. CellSAM has the potential to improve the effectiveness and precision of disease identification and therapy planning. As a variant of SAM, CellSAM integrates dual‐image encoders and employs techniques such as knowledge distillation and mask fusion. This innovative model exhibits promising capabilities in capturing intricate cell structures and ensuring adaptability in resource‐constrained scenarios. The experimental results indicate that this structure effectively enhances the quality and precision of cell segmentation. Remarkably, CellSAM demonstrates outstanding results even with minimal training data. In the evaluation of particular cell segmentation tasks, extensive comparative analyzes show that CellSAM outperforms both general fundamental models and state‐of‐the‐art (SOTA) task‐specific models. Comprehensive evaluation metrics yield scores of 0.884, 0.876, and 0.768 for mean accuracy, recall, and precision respectively. Extensive experiments show that CellSAM excels in capturing subtle details and complex structures and is capable of segmenting cells in images accurately. Additionally, CellSAM demonstrates excellent performance on clinical data, indicating its potential for robust applications in treatment planning and disease diagnosis, thereby further improving the efficiency of computer‐aided medicine.

Cell Segmentation Via Spectral Analysis on Phase Retardation Features

Cell Segmentation in Phase Contrast Microscopy Images Via Semi-Supervised Classification over Optics-Related Features

Interactive Cell Segmentation Based on Phase Contrast Optics

Reliable Cell Segmentation Based on Spectral Phasor Analysis of Hyperspectral Stimulated Raman Scattering Imaging Data

Cell-sensitive microscopy imaging for cell image segmentation.

Phase contrast image restoration via dictionary representation of diffraction patterns.

A Fuzzy Segmentation Method to Learn Classification of Mitosis

An Efficient Cell Segmentation Algorithm Based on Unsupervised Clustering and Morphology

Image segmentation based on multiscale fast spectral clustering

Cell segmentation methods for label-free contrast microscopy: review and comprehensive comparison

Modified SLIC Segmentation for Medical Hyperspectral Cell Images

A Spectral Clustering Image Segmentation Algorithm Based on Nyström Approximation

An Energy Conduction Model for Cell Image Segmentation

Cell-sensitive Phase Contrast Microscopy Imaging by Multiple Exposures

Unsupervised high-throughput segmentation of cells and cell nuclei in quantitative phase images

A High Resolution Image Segmentation Method by Combined Structural and Spectral Characteristics

A Practical Segmentation Method for Automated Screening of Cervical Cytology

CellSAM: Advancing Pathologic Image Cell Segmentation via Asymmetric Large‐Scale Vision Model Feature Distillation Aggregation Network

Image segmentation based on modified superpixel segmentation and spectral clustering

Interactive Cell Segmentation Based on Active and Semi-Supervised Learning