Abstract:Abstract Medical image segmentation is a critical component in clinical practice, facilitating accurate diagnosis, treatment planning, and disease monitoring. However, existing methods, often tailored to specific modalities or disease types, lack generalizability across the diverse spectrum of medical image segmentation tasks. Here we present MedSAM, a foundation model designed for bridging this gap by enabling universal medical image segmentation. The model is developed on a large-scale medical image dataset with 1,570,263 image-mask pairs, covering 10 imaging modalities and over 30 cancer types. We conduct a comprehensive evaluation on 86 internal validation tasks and 60 external validation tasks, demonstrating better accuracy and robustness than modality-wise specialist models. By delivering accurate and efficient segmentation across a wide spectrum of tasks, MedSAM holds significant potential to expedite the evolution of diagnostic tools and the personalization of treatment plans.

What problem does this paper attempt to address?

This paper primarily focuses on the issue of medical image segmentation. Current medical image segmentation methods often target specific imaging modalities or disease types, lacking generalizability across various medical image segmentation tasks. Researchers have proposed a foundational model named MedSAM, which aims to bridge this gap by being applicable to a wide range of medical image segmentation tasks through a single training session. MedSAM is developed based on a large-scale medical image dataset containing over 1.57 million image-mask pairs, covering 10 imaging modalities and more than 30 types of cancer. The paper mentions that although deep learning models perform well in medical image segmentation, they are usually tailored for specific tasks, and their performance declines when applied to new tasks or different types of imaging data. In contrast, foundational models in the natural image segmentation domain (such as SAM) have demonstrated versatility and high performance across multiple tasks. However, the direct application of these models to medical image segmentation is limited by the significant differences between medical and natural images. MedSAM enhances performance by fine-tuning SAM to adapt to medical images, particularly in the segmentation of targets with weak boundaries or low contrast. Through comprehensive evaluation on 86 internal validation tasks and 60 external validation tasks, MedSAM has shown higher accuracy and robustness than specialized models, and in some cases, comparable or better performance than professional models trained for the same imaging modality. This suggests that MedSAM has the potential to accelerate the development of diagnostic tools and the personalization of treatment plans, holding significant promise for medical image analysis.

Segment anything in medical images