Towards foundation models of biological image segmentation

Jun Ma,Bo Wang

DOI: https://doi.org/10.1038/s41592-023-01885-0

IF: 48

2023-07-01

Nature Methods

Abstract:In the ever-evolving landscape of biological imaging technology, it is crucial to develop foundation models capable of adapting to various imaging modalities and tackling complex segmentation tasks.

biochemical research methods

What problem does this paper attempt to address?

Foundation Models for Biomedical Image Segmentation: A Survey

Ho Hin Lee,Yu Gu,Theodore Zhao,Yanbo Xu,Jianwei Yang,Naoto Usuyama,Cliff Wong,Mu Wei,Bennett A. Landman,Yuankai Huo,Alberto Santamaria-Pang,Hoifung Poon

2024-01-15

Abstract:Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for general-purpose computer vision, has found rapid application in medical image processing. Within the last year, marked by over 100 publications, SAM has demonstrated its prowess in zero-shot learning adaptations for medical imaging. The fundamental premise of SAM lies in its capability to segment or identify objects in images without prior knowledge of the object type or imaging modality. This approach aligns well with tasks achievable by the human visual system, though its application in non-biological vision contexts remains more theoretically challenging. A notable feature of SAM is its ability to adjust segmentation according to a specified resolution scale or area of interest, akin to semantic priming. This adaptability has spurred a wave of creativity and innovation in applying SAM to medical imaging. Our review focuses on the period from April 1, 2023, to September 30, 2023, a critical first six months post-initial publication. We examine the adaptations and integrations of SAM necessary to address longstanding clinical challenges, particularly in the context of 33 open datasets covered in our analysis. While SAM approaches or achieves state-of-the-art performance in numerous applications, it falls short in certain areas, such as segmentation of the carotid artery, adrenal glands, optic nerve, and mandible bone. Our survey delves into the innovative techniques where SAM's foundational approach excels and explores the core concepts in translating and applying these models effectively in diverse medical imaging scenarios.

Computer Vision and Pattern Recognition
Image Segmentation in Foundation Model Era: A Survey

Tianfei Zhou,Fei Zhang,Boyu Chang,Wenguan Wang,Ye Yuan,Ender Konukoglu,Daniel Cremers

2024-10-29

Abstract:Image segmentation is a long-standing challenge in computer vision, studied continuously over several decades, as evidenced by seminal algorithms such as N-Cut, FCN, and MaskFormer. With the advent of foundation models (FMs), contemporary segmentation methodologies have embarked on a new epoch by either adapting FMs (e.g., CLIP, Stable Diffusion, DINO) for image segmentation or developing dedicated segmentation foundation models (e.g., SAM). These approaches not only deliver superior segmentation performance, but also herald newfound segmentation capabilities previously unseen in deep learning context. However, current research in image segmentation lacks a detailed analysis of distinct characteristics, challenges, and solutions associated with these advancements. This survey seeks to fill this gap by providing a thorough review of cutting-edge research centered around FM-driven image segmentation. We investigate two basic lines of research -- generic image segmentation (i.e., semantic segmentation, instance segmentation, panoptic segmentation), and promptable image segmentation (i.e., interactive segmentation, referring segmentation, few-shot segmentation) -- by delineating their respective task settings, background concepts, and key challenges. Furthermore, we provide insights into the emergence of segmentation knowledge from FMs like CLIP, Stable Diffusion, and DINO. An exhaustive overview of over 300 segmentation approaches is provided to encapsulate the breadth of current research efforts. Subsequently, we engage in a discussion of open issues and potential avenues for future research. We envisage that this fresh, comprehensive, and systematic survey catalyzes the evolution of advanced image segmentation systems.

Computer Vision and Pattern Recognition
Integrative Approaches in Computational Biomedical Imaging

Huafeng Liu,Pengcheng Shi,Yunmei Chen

DOI: https://doi.org/10.1155/2012/162892

IF: 2.809

2012-01-01

Computational and Mathematical Methods in Medicine

Abstract:Increasingly wider availability of biomedical imaging modalities, such as X-ray computed tomography (CT), magnetic resonance imaging (MRI), ultrasonic imaging, positron emission tomography (PET), single-photon emission computed tomography (SPECT), and optical imaging, have led to significant progresses in both biomedical research and clinical practice. Advancements in imaging technology and image informatics have facilitated and enabled quantitative understanding of the biological structures, functional organisms, and pathological mechanisms. This special issue presents 14 latest research contributions in computational biomedical imaging. The focuses have been on the computational principles, strategies, methods, and algorithms that create, extract, and understand imaging data of biomedical significance. The first group of papers has showcased the development and applications of rigorous optimization techniques in biomedical imaging. The work based on dual unscented Kalman filtering provides a reliable and efficient platform to understand the BOLD signals from fMRI. In the other paper, the robust discrete particle swarm optimization algorithm is adopted to solve the branch-cut phase unwrapping problem of MRI data. Without the need for a regularization penalty term, a semigreed method for bioluminescence tomography reconstruction is fast and stable for small animal imaging. The second group of papers has addressed image segmentation and tissue characterization problems, ever popular among image analysis researchers. The work of L. Li et al. applies machine learning techniques to characterize lymph node metastasis in gastric cancer from gemstone spectral imaging with much improved outcomes, while G. V. Sanchez. Ferrero et al. make new advances in ultrasonic speckle characterization using generalized Gama distribution and generalized Gama mixture model. In recent years, physically meaningful modeling and simulation have become integral components for model-constrained imaging and model-based image understanding. Thus, the third group of papers has continued the stride in this direction. The propagation of myocardial electrical activation is simulated using a monodomain model, without the need of explicit mesh constraints. In similar spirit, one work performs forward modeling of 3D optical molecular imaging with simplified spherical harmonics approximation using extended finite element method. The final group of papers has highlighted some new imaging modalities and their potential use in clinical practice. The further development of ultrasound-based quantitative imaging of Young's modulus with high accuracy is presented in this issue. And the novel Diffusion Kurtosis Imaging shows that more detailed classification of brain tissues is clinical significance. We appreciate the many high quality submissions to this special issue from leading researchers in computational biomedical imaging. Because of space limitation, we can only accept a small number of most exciting works. We sincerely hope that the remaining interesting research outcomes will be soon published in other venues.
Beyond Pixel-Wise Supervision for Medical Image Segmentation: From Traditional Models to Foundation Models

Yuyan Shi,Jialu Ma,Jin Yang,Shasha Wang,Yichi Zhang

2024-04-20

Abstract:Medical image segmentation plays an important role in many image-guided clinical approaches. However, existing segmentation algorithms mostly rely on the availability of fully annotated images with pixel-wise annotations for training, which can be both labor-intensive and expertise-demanding, especially in the medical imaging domain where only experts can provide reliable and accurate annotations. To alleviate this challenge, there has been a growing focus on developing segmentation methods that can train deep models with weak annotations, such as image-level, bounding boxes, scribbles, and points. The emergence of vision foundation models, notably the Segment Anything Model (SAM), has introduced innovative capabilities for segmentation tasks using weak annotations for promptable segmentation enabled by large-scale pre-training. Adopting foundation models together with traditional learning methods has increasingly gained recent interest research community and shown potential for real-world applications. In this paper, we present a comprehensive survey of recent progress on annotation-efficient learning for medical image segmentation utilizing weak annotations before and in the era of foundation models. Furthermore, we analyze and discuss several challenges of existing approaches, which we believe will provide valuable guidance for shaping the trajectory of foundational models to further advance the field of medical image segmentation.

Computer Vision and Pattern Recognition
Foundation AI Model for Medical Image Segmentation

Rina Bao,Erfan Darzi,Sheng He,Chuan-Heng Hsiao,Mohammad Arafat Hussain,Jingpeng Li,Atle Bjornerud,Ellen Grant,Yangming Ou

2024-11-05

Abstract:Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or one-for-all solutions, eliminating the need for developing task-specific AI models. Examples of such foundation models include the Chat Generative Pre-trained Transformer (ChatGPT) and the Segment Anything Model (SAM). These models have been trained on millions to billions of samples and have shown wide-ranging and accurate applications in numerous tasks such as text processing (using ChatGPT) and natural image segmentation (using SAM). In medical image segmentation - finding target regions in medical images - there is a growing need for these one-for-many or one-for-all foundation models. Such models could obviate the need to develop thousands of task-specific AI models, which is currently standard practice in the field. They can also be adapted to tasks with datasets too small for effective training. We discuss two paths to achieve foundation models for medical image segmentation and comment on progress, challenges, and opportunities. One path is to adapt or fine-tune existing models, originally developed for natural images, for use with medical images. The second path entails building models from scratch, exclusively training on medical images.

Image and Video Processing,Computer Vision and Pattern Recognition
Empirical Analysis of a Segmentation Foundation Model in Prostate Imaging

Heejong Kim,Victor Ion Butoi,Adrian V. Dalca,Daniel J.A. Margolis,Mert R. Sabuncu

2023-10-03

Abstract:Most state-of-the-art techniques for medical image segmentation rely on deep-learning models. These models, however, are often trained on narrowly-defined tasks in a supervised fashion, which requires expensive labeled datasets. Recent advances in several machine learning domains, such as natural language generation have demonstrated the feasibility and utility of building foundation models that can be customized for various downstream tasks with little to no labeled data. This likely represents a paradigm shift for medical imaging, where we expect that foundation models may shape the future of the field. In this paper, we consider a recently developed foundation model for medical image segmentation, UniverSeg. We conduct an empirical evaluation study in the context of prostate imaging and compare it against the conventional approach of training a task-specific segmentation model. Our results and discussion highlight several important factors that will likely be important in the development and adoption of foundation models for medical image segmentation.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
A Focus on Recent Development of Image Segmentation

Yujie Li,Huiming Lu,Shyuan Yang,Lifeng Zhang,Seiichi Serikawa

DOI: https://doi.org/10.12792/jiiae.2.6

2014-01-01

Journal of the Institute of Industrial Applications Engineers

Abstract:In this paper, we proposed some segmentation methods for getting better results in medical image segmentation systems. With the rapid development of computer technology and digital medical imaging equipment, medical imaging technology has made a rapid development. Its principle is with the energy and the biology of some kind of interaction, extract information about biological tissue or organs in the body shape, structure and some physiological function, then provides for the organization of biological research and clinical diagnosis. Firstly, we use granularity analysis method and morphology method to recognize the blood cancer cells, then we developed a new theoretical approach to automatically selecting the weighting exponent in the FCM to segment the medical images, at last we propose a new model for active contours to detect cell objects in a X-ray Inspection segmentation system
A foundation model for joint segmentation, detection and recognition of biomedical objects across nine modalities

Theodore Zhao,Yu Gu,Jianwei Yang,Naoto Usuyama,Ho Hin Lee,Sid Kiblawi,Tristan Naumann,Jianfeng Gao,Angela Crabtree,Jacob Abel,Christine Moung-Wen,Brian Piening,Carlo Bifulco,Mu Wei,Hoifung Poon,Sheng Wang

DOI: https://doi.org/10.1038/s41592-024-02499-w

IF: 48

2024-11-24

Nature Methods

Abstract:Biomedical image analysis is fundamental for biomedical discovery. Holistic image analysis comprises interdependent subtasks such as segmentation, detection and recognition, which are tackled separately by traditional approaches. Here, we propose BiomedParse, a biomedical foundation model that can jointly conduct segmentation, detection and recognition across nine imaging modalities. This joint learning improves the accuracy for individual tasks and enables new applications such as segmenting all relevant objects in an image through a textual description. To train BiomedParse, we created a large dataset comprising over 6 million triples of image, segmentation mask and textual description by leveraging natural language labels or descriptions accompanying existing datasets. We showed that BiomedParse outperformed existing methods on image segmentation across nine imaging modalities, with larger improvement on objects with irregular shapes. We further showed that BiomedParse can simultaneously segment and label all objects in an image. In summary, BiomedParse is an all-in-one tool for biomedical image analysis on all major image modalities, paving the path for efficient and accurate image-based biomedical discovery.

biochemical research methods
On the Challenges and Perspectives of Foundation Models for Medical Image Analysis

Shaoting Zhang,Dimitris Metaxas

2023-11-22

Abstract:This article discusses the opportunities, applications and future directions of large-scale pre-trained models, i.e., foundation models, for analyzing medical images. Medical foundation models have immense potential in solving a wide range of downstream tasks, as they can help to accelerate the development of accurate and robust models, reduce the large amounts of required labeled data, preserve the privacy and confidentiality of patient data. Specifically, we illustrate the "spectrum" of medical foundation models, ranging from general vision models, modality-specific models, to organ/task-specific models, highlighting their challenges, opportunities and applications. We also discuss how foundation models can be leveraged in downstream medical tasks to enhance the accuracy and efficiency of medical image analysis, leading to more precise diagnosis and treatment decisions.

Image and Video Processing,Computer Vision and Pattern Recognition
Two-stage Generative Models of Simulating Training Data at the Voxel Level for Large-Scale Microscopy Bioimage Segmentation

Deli Wang,Ting Zhao,Nenggan Zheng,Zhefeng Gong

DOI: https://doi.org/10.24963/ijcai.2019/664

2019-01-01

Abstract:Bioimage Informatics is a growing area that aims to extract biological knowledge from microscope images of biomedical samples automatically. Its mission is vastly challenging, however, due to the complexity of diverse imaging modalities and big scales of multi-dimensional images. One major challenge is automatic image segmentation, an essential step towards high-level modeling and analysis. While progresses in deep learning have brought the goal of automation much closer to reality, creating training data for producing powerful neural networks is often laborious. To provide a shortcut for this costly step, we propose a novel two-stage generative model for simulating voxel level training data based on a specially designed objective function of preserving foreground labels. Using segmenting neurons from LM (Light Microscopy) image stacks as a testing example, we showed that segmentation networks trained by our synthetic data were able to produce satisfactory results. Unlike other simulation methods available in the field, our method can be easily extended to many other applications because it does not involve sophisticated cell models and imaging mechanisms.
How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Model

Hanxue Gu,Haoyu Dong,Jichen Yang,Maciej A. Mazurowski

2024-05-13

Abstract:Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for some time, the foundation model developed with image segmentation in mind - Segment Anything Model (SAM) - has been developed only recently and has shown similar promise. However, there are still no systematic analyses or "best-practice" guidelines for optimal fine-tuning of SAM for medical image segmentation. This work summarizes existing fine-tuning strategies with various backbone architectures, model components, and fine-tuning algorithms across 18 combinations, and evaluates them on 17 datasets covering all common radiology modalities. Our study reveals that (1) fine-tuning SAM leads to slightly better performance than previous segmentation methods, (2) fine-tuning strategies that use parameter-efficient learning in both the encoder and decoder are superior to other strategies, (3) network architecture has a small impact on final performance, (4) further training SAM with self-supervised learning can improve final model performance. We also demonstrate the ineffectiveness of some methods popular in the literature and further expand our experiments into few-shot and prompt-based settings. Lastly, we released our code and MRI-specific fine-tuned weights, which consistently obtained superior performance over the original SAM, at

Computer Vision and Pattern Recognition,Machine Learning
Foundational Models in Medical Imaging: A Comprehensive Survey and Future Vision

Bobby Azad,Reza Azad,Sania Eskandari,Afshin Bozorgpour,Amirhossein Kazerouni,Islem Rekik,Dorit Merhof

2023-10-28

Abstract:Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these models. Trained on large-scale dataset to bridge the gap between different modalities, foundation models facilitate contextual reasoning, generalization, and prompt capabilities at test time. The predictions of these models can be adjusted for new tasks by augmenting the model input with task-specific hints called prompts without requiring extensive labeled data and retraining. Capitalizing on the advances in computer vision, medical imaging has also marked a growing interest in these models. To assist researchers in navigating this direction, this survey intends to provide a comprehensive overview of foundation models in the domain of medical imaging. Specifically, we initiate our exploration by providing an exposition of the fundamental concepts forming the basis of foundation models. Subsequently, we offer a methodical taxonomy of foundation models within the medical domain, proposing a classification system primarily structured around training strategies, while also incorporating additional facets such as application domains, imaging modalities, specific organs of interest, and the algorithms integral to these models. Furthermore, we emphasize the practical use case of some selected approaches and then discuss the opportunities, applications, and future directions of these large-scale pre-trained models, for analyzing medical images. In the same vein, we address the prevailing challenges and research pathways associated with foundational models in medical imaging. These encompass the areas of interpretability, data management, computational requirements, and the nuanced issue of contextual comprehension.

Computer Vision and Pattern Recognition
A Foundation Model for General Moving Object Segmentation in Medical Images.

Zhongnuo Yan,Tong Han,Yuhao Huang,Lian Liu,Han Zhou,Jiongquan Chen,Wenlong Shi,Yan Cao,Xin Yang,Dong Ni

DOI: https://doi.org/10.1109/isbi56570.2024.10635664

2024-01-01

Abstract:Medical image segmentation aims to delineate the anatomical or pathologicalstructures of interest, playing a crucial role in clinical diagnosis. Asubstantial amount of high-quality annotated data is crucial for constructinghigh-precision deep segmentation models. However, medical annotation is highlycumbersome and time-consuming, especially for medical videos or 3D volumes, dueto the huge labeling space and poor inter-frame consistency. Recently, afundamental task named Moving Object Segmentation (MOS) has made significantadvancements in natural images. Its objective is to delineate moving objectsfrom the background within image sequences, requiring only minimal annotations.In this paper, we propose the first foundation model, named iMOS, for MOS inmedical images. Extensive experiments on a large multi-modal medical datasetvalidate the effectiveness of the proposed iMOS. Specifically, with theannotation of only a small number of images in the sequence, iMOS can achievesatisfactory tracking and segmentation performance of moving objects throughoutthe entire sequence in bi-directions. We hope that the proposed iMOS can helpaccelerate the annotation speed of experts, and boost the development ofmedical foundation models.
A Foundation Model for Cell Segmentation

Uriah Israel,Markus Marks,Rohit Dilip,Qilin Li,Changhua Yu,Emily Laubscher,Shenyi Li,Morgan Schwartz,Elora Pradhan,Ada Ates,Martin Abt,Caitlin Brown,Edward Pao,Alexander Pearson-Goulart,Pietro Perona,Georgia Gkioxari,Ross Barnowski,Yisong Yue,David Van Valen

DOI: https://doi.org/10.1101/2023.11.17.567630

2024-03-07

Abstract:Cells are a fundamental unit of biological organization, and identifying them in imaging data – cell segmentation – is a critical task for various cellular imaging experiments. While deep learning methods have led to substantial progress on this problem, most models in use are specialist models that work well for specific domains. Methods that have learned the general notion of “what is a cell” and can identify them across different domains of cellular imaging data have proven elusive. In this work, we present CellSAM, a foundation model for cell segmentation that generalizes across diverse cellular imaging data. CellSAM builds on top of the Segment Anything Model (SAM) by developing a prompt engineering approach for mask generation. We train an object detector, CellFinder, to automatically detect cells and prompt SAM to generate segmentations. We show that this approach allows a single model to achieve human-level performance for segmenting images of mammalian cells (in tissues and cell culture), yeast, and bacteria collected across various imaging modalities. We show that CellSAM has strong zero-shot performance and can be improved with a few examples via few-shot learning. We also show that CellSAM can unify bioimaging analysis workflows such as spatial transcriptomics and cell tracking. A deployed version of CellSAM is available at .

Bioinformatics
Towards Segment Anything Model (SAM) for Medical Image Segmentation: A Survey

Yichi Zhang,Rushi Jiao

2023-08-11

Abstract:Due to the flexibility of prompting, foundation models have become the dominant force in the domains of natural language processing and image generation. With the recent introduction of the Segment Anything Model (SAM), the prompt-driven paradigm has entered the realm of image segmentation, bringing with a range of previously unexplored capabilities. However, it remains unclear whether it can be applicable to medical image segmentation due to the significant differences between natural images and medical <a class="link-external link-http" href="http://images.In" rel="external noopener nofollow">this http URL</a> this work, we summarize recent efforts to extend the success of SAM to medical image segmentation tasks, including both empirical benchmarking and methodological adaptations, and discuss potential future directions for SAM in medical image segmentation. Although directly applying SAM to medical image segmentation cannot obtain satisfying performance on multi-modal and multi-target medical datasets, many insights are drawn to guide future research to develop foundation models for medical image analysis. To facilitate future research, we maintain an active repository that contains up-to-date paper list and open-source project summary at <a class="link-external link-https" href="https://github.com/YichiZhang98/SAM4MIS" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
SegVol: Universal and Interactive Volumetric Medical Image Segmentation

Yuxin Du,Fan Bai,Tiejun Huang,Bo Zhao

2024-08-29

Abstract:Precise image segmentation provides clinical study with instructive information. Despite the remarkable progress achieved in medical image segmentation, there is still an absence of a 3D foundation segmentation model that can segment a wide range of anatomical categories with easy user interaction. In this paper, we propose a 3D foundation segmentation model, named SegVol, supporting universal and interactive volumetric medical image segmentation. By scaling up training data to 90K unlabeled Computed Tomography (CT) volumes and 6K labeled CT volumes, this foundation model supports the segmentation of over 200 anatomical categories using semantic and spatial prompts. To facilitate efficient and precise inference on volumetric images, we design a zoom-out-zoom-in mechanism. Extensive experiments on 22 anatomical segmentation tasks verify that SegVol outperforms the competitors in 19 tasks, with improvements up to 37.24% compared to the runner-up methods. We demonstrate the effectiveness and importance of specific designs by ablation study. We expect this foundation model can promote the development of volumetric medical image analysis. The model and code are publicly available at: <a class="link-external link-https" href="https://github.com/BAAI-DCAI/SegVol" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Streamlined Photoacoustic Image Processing with Foundation Models: A Training-Free Solution

Handi Deng,Yucheng Zhou,Jiaxuan Xiang,Liujie Gu,Yan Luo,Hai Feng,Mingyuan Liu,Cheng Ma

2024-04-11

Abstract:Foundation models have rapidly evolved and have achieved significant accomplishments in computer vision tasks. Specifically, the prompt mechanism conveniently allows users to integrate image prior information into the model, making it possible to apply models without any training. Therefore, we propose a method based on foundation models and zero training to solve the tasks of photoacoustic (PA) image segmentation. We employed the segment anything model (SAM) by setting simple prompts and integrating the model's outputs with prior knowledge of the imaged objects to accomplish various tasks, including: (1) removing the skin signal in three-dimensional PA image rendering; (2) dual speed-of-sound reconstruction, and (3) segmentation of finger blood vessels. Through these demonstrations, we have concluded that deep learning can be directly applied in PA imaging without the requirement for network design and training. This potentially allows for a hands-on, convenient approach to achieving efficient and accurate segmentation of PA images. This letter serves as a comprehensive tutorial, facilitating the mastery of the technique through the provision of code and sample datasets.

Computer Vision and Pattern Recognition,Machine Learning
Segment anything model for medical image segmentation: Current applications and future directions

Yichi Zhang,Zhenrong Shen,Rushi Jiao

DOI: https://doi.org/10.1016/j.compbiomed.2024.108238

IF: 7.7

2024-02-29

Computers in Biology and Medicine

Abstract:Due to the inherent flexibility of prompting, foundation models have emerged as the predominant force in the fields of natural language processing and computer vision. The recent introduction of the Segment Anything Model (SAM) signifies a noteworthy expansion of the prompt-driven paradigm into the domain of image segmentation, thereby introducing a plethora of previously unexplored capabilities. However, the viability of its application to medical image segmentation remains uncertain, given the substantial distinctions between natural and medical images. In this work, we provide a comprehensive overview of recent endeavors aimed at extending the efficacy of SAM to medical image segmentation tasks, encompassing both empirical benchmarking and methodological adaptations. Additionally, we explore potential avenues for future research directions in SAM's role within medical image segmentation. While direct application of SAM to medical image segmentation does not yield satisfactory performance on multi-modal and multi-target medical datasets so far, numerous insights gleaned from these efforts serve as valuable guidance for shaping the trajectory of foundational models in the realm of medical image analysis. To support ongoing research endeavors, we maintain an active repository that contains an up-to-date paper list and a succinct summary of open-source projects at https://github.com/YichiZhang98/SAM4MIS .

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
[The State and Development of Cell Image Segmentation Technology].

Yide Ma,Rolan Dai,Lian Li,Chenghu Wu

DOI: https://doi.org/10.3321/j.issn:1001-5515.2002.03.034

2002-01-01

Abstract:This paper describes the state and the development of the application of the modern and traditional image segmentation technology in cell slice image segmentation. It includes edge detection, regional segmentation, wavelet transform, fuzzy mathematics, artificial neural networks, morphological image segmentation and so on. At last, the paper summaries that it is difficult to generally segmentate any kind of biological cell slice image automatically because of the complex structure of cell and cell slice image is not even gray distributed. It should be pointed out that general automatic cell slice image segmentation will be achieved only if visual mathematics model corresponding to mammalian vision systems is setup entirely.

Towards foundation models of biological image segmentation

Foundation Models for Biomedical Image Segmentation: A Survey

Image Segmentation in Foundation Model Era: A Survey

Integrative Approaches in Computational Biomedical Imaging

Beyond Pixel-Wise Supervision for Medical Image Segmentation: From Traditional Models to Foundation Models

Foundation AI Model for Medical Image Segmentation

Empirical Analysis of a Segmentation Foundation Model in Prostate Imaging

A Focus on Recent Development of Image Segmentation

A foundation model for joint segmentation, detection and recognition of biomedical objects across nine modalities

On the Challenges and Perspectives of Foundation Models for Medical Image Analysis

Two-stage Generative Models of Simulating Training Data at the Voxel Level for Large-Scale Microscopy Bioimage Segmentation

How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Model

Foundational Models in Medical Imaging: A Comprehensive Survey and Future Vision

A Foundation Model for General Moving Object Segmentation in Medical Images.

A Foundation Model for Cell Segmentation

Towards Segment Anything Model (SAM) for Medical Image Segmentation: A Survey

SegVol: Universal and Interactive Volumetric Medical Image Segmentation

Streamlined Photoacoustic Image Processing with Foundation Models: A Training-Free Solution

Segment anything model for medical image segmentation: Current applications and future directions

[The State and Development of Cell Image Segmentation Technology].