Autoprotective mechanisms in the CNS: some new lessons from white matter.

R. Fern,B. Ransom,S. Waxman

DOI: https://doi.org/10.1007/BF02815088

1996-02-01

Molecular and Chemical Neuropathology

Abstract:

What problem does this paper attempt to address?

Recurrent Mask Refinement for Few-Shot Medical Image Segmentation

Hao Tang,Xingwei Liu,Shanlin Sun,Xiangyi Yan,Xiaohui Xie

DOI: https://doi.org/10.48550/arXiv.2108.00622

2021-08-04

Abstract:Although having achieved great success in medical image segmentation, deep convolutional neural networks usually require a large dataset with manual annotations for training and are difficult to generalize to unseen classes. Few-shot learning has the potential to address these challenges by learning new classes from only a few labeled examples. In this work, we propose a new framework for few-shot medical image segmentation based on prototypical networks. Our innovation lies in the design of two key modules: 1) a context relation encoder (CRE) that uses correlation to capture local relation features between foreground and background regions; and 2) a recurrent mask refinement module that repeatedly uses the CRE and a prototypical network to recapture the change of context relationship and refine the segmentation mask iteratively. Experiments on two abdomen CT datasets and an abdomen MRI dataset show the proposed method obtains substantial improvement over the state-of-the-art methods by an average of 16.32%, 8.45% and 6.24% in terms of DSC, respectively. Code is publicly available.

Computer Vision and Pattern Recognition
Few-Shot Medical Image Segmentation with Large Kernel Attention

Xiaoxiao Wu,Xiaowei Chen,Zhenguo Gao,Shulei Qu,Yuanyuan Qiu

2024-07-27

Abstract:Medical image segmentation has witnessed significant advancements with the emergence of deep learning. However, the reliance of most neural network models on a substantial amount of annotated data remains a challenge for medical image segmentation. To address this issue, few-shot segmentation methods based on meta-learning have been employed. Presently, the methods primarily focus on aligning the support set and query set to enhance performance, but this approach hinders further improvement of the model's effectiveness. In this paper, our objective is to propose a few-shot medical segmentation model that acquire comprehensive feature representation capabilities, which will boost segmentation accuracy by capturing both local and long-range features. To achieve this, we introduce a plug-and-play attention module that dynamically enhances both query and support features, thereby improving the representativeness of the extracted features. Our model comprises four key modules: a dual-path feature extractor, an attention module, an adaptive prototype prediction module, and a multi-scale prediction fusion module. Specifically, the dual-path feature extractor acquires multi-scale features by obtaining features of 32{\times}32 size and 64{\times}64 size. The attention module follows the feature extractor and captures local and long-range information. The adaptive prototype prediction module automatically adjusts the anomaly score threshold to predict prototypes, while the multi-scale fusion prediction module integrates prediction masks of various scales to produce the final segmentation result. We conducted experiments on publicly available MRI datasets, namely CHAOS and CMR, and compared our method with other advanced techniques. The results demonstrate that our method achieves state-of-the-art performance.

Computer Vision and Pattern Recognition
Few-shot Medical Image Segmentation with Cycle-resemblance Attention

Hao Ding,Changchang Sun,Hao Tang,Dawen Cai,Yan Yan

DOI: https://doi.org/10.48550/arXiv.2212.03967

2022-12-07

Computer Vision and Pattern Recognition

Abstract:Recently, due to the increasing requirements of medical imaging applications and the professional requirements of annotating medical images, few-shot learning has gained increasing attention in the medical image semantic segmentation field. To perform segmentation with limited number of labeled medical images, most existing studies use Proto-typical Networks (PN) and have obtained compelling success. However, these approaches overlook the query image features extracted from the proposed representation network, failing to preserving the spatial connection between query and support images. In this paper, we propose a novel self-supervised few-shot medical image segmentation network and introduce a novel Cycle-Resemblance Attention (CRA) module to fully leverage the pixel-wise relation between query and support medical images. Notably, we first line up multiple attention blocks to refine more abundant relation information. Then, we present CRAPNet by integrating the CRA module with a classic prototype network, where pixel-wise relations between query and support features are well recaptured for segmentation. Extensive experiments on two different medical image datasets, e.g., abdomen MRI and abdomen CT, demonstrate the superiority of our model over existing state-of-the-art methods.
Few Shot Medical Image Segmentation with Cross Attention Transformer

Yi Lin,Yufan Chen,Kwang-Ting Cheng,Hao Chen

2023-09-21

Abstract:Medical image segmentation has made significant progress in recent years. Deep learning-based methods are recognized as data-hungry techniques, requiring large amounts of data with manual annotations. However, manual annotation is expensive in the field of medical image analysis, which requires domain-specific expertise. To address this challenge, few-shot learning has the potential to learn new classes from only a few examples. In this work, we propose a novel framework for few-shot medical image segmentation, termed CAT-Net, based on cross masked attention Transformer. Our proposed network mines the correlations between the support image and query image, limiting them to focus only on useful foreground information and boosting the representation capacity of both the support prototype and query features. We further design an iterative refinement framework that refines the query image segmentation iteratively and promotes the support feature in turn. We validated the proposed method on three public datasets: Abd-CT, Abd-MRI, and Card-MRI. Experimental results demonstrate the superior performance of our method compared to state-of-the-art methods and the effectiveness of each component. Code: <a class="link-external link-https" href="https://github.com/hust-linyi/CAT-Net" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
'Squeeze & Excite' Guided Few-Shot Segmentation of Volumetric Images

Abhijit Guha Roy,Shayan Siddiqui,Sebastian Pölsterl,Nassir Navab,Christian Wachinger

DOI: https://doi.org/10.48550/arXiv.1902.01314

2019-10-11

Abstract:Deep neural networks enable highly accurate image segmentation, but require large amounts of manually annotated data for supervised training. Few-shot learning aims to address this shortcoming by learning a new class from a few annotated support examples. We introduce, a novel few-shot framework, for the segmentation of volumetric medical images with only a few annotated slices. Compared to other related works in computer vision, the major challenges are the absence of pre-trained networks and the volumetric nature of medical scans. We address these challenges by proposing a new architecture for few-shot segmentation that incorporates 'squeeze & excite' blocks. Our two-armed architecture consists of a conditioner arm, which processes the annotated support input and generates a task-specific representation. This representation is passed on to the segmenter arm that uses this information to segment the new query image. To facilitate efficient interaction between the conditioner and the segmenter arm, we propose to use 'channel squeeze & spatial excitation' blocks - a light-weight computational module - that enables heavy interaction between both the arms with negligible increase in model complexity. This contribution allows us to perform image segmentation without relying on a pre-trained model, which generally is unavailable for medical scans. Furthermore, we propose an efficient strategy for volumetric segmentation by optimally pairing a few slices of the support volume to all the slices of the query volume. We perform experiments for organ segmentation on whole-body contrast-enhanced CT scans from the Visceral Dataset. Our proposed model outperforms multiple baselines and existing approaches with respect to the segmentation accuracy by a significant margin. The source code is available at <a class="link-external link-https" href="https://github.com/abhi4ssj/few-shot-segmentation" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Bidirectional RNN-based Few Shot Learning for 3D Medical Image Segmentation

Soopil Kim,Sion An,Philip Chikontwe,Sang Hyun Park

DOI: https://doi.org/10.1609/aaai.v35i3.16275

2021-05-18

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Segmentation of organs of interest in 3D medical images is necessary for accurate diagnosis and longitudinal studies. Though recent advances using deep learning have shown success for many segmentation tasks, large datasets are required for high performance and the annotation process is both time consuming and labor intensive. In this paper, we propose a 3D few shot segmentation framework for accurate organ segmentation using limited training samples of the target organ annotation. To achieve this, a U-Net like network is designed to predict segmentation by learning the relationship between 2D slices of support data and a query image, including a bidirectional gated recurrent unit (GRU) that learns consistency of encoded features between adjacent slices. Also, we introduce a transfer learning method to adapt the characteristics of the target image and organ by updating the model before testing with arbitrary support and query data sampled from the support data. We evaluate our proposed model using three 3D CT datasets with annotations of different organs. Our model yielded significantly improved performance over state-of-the-art few shot segmentation models and was comparable to a fully supervised model trained with more target training data.
A Unified Framework for Generalized Low-Shot Medical Image Segmentation With Scarce Data

Hengji Cui,Dong Wei,Kai Ma,Shi Gu,Yefeng Zheng

DOI: https://doi.org/10.1109/tmi.2020.3045775

IF: 10.6

2021-10-01

IEEE Transactions on Medical Imaging

Abstract:Medical image segmentation has achieved remarkable advancements using deep neural networks (DNNs). However, DNNs often need big amounts of data and annotations for training, both of which can be difficult and costly to obtain. In this work, we propose a unified framework for generalized low-shot (one- and few-shot) medical image segmentation based on distance metric learning (DML). Unlike most existing methods which only deal with the lack of annotations while assuming abundance of data, our framework works with extreme scarcity of both, which is ideal for rare diseases. Via DML, the framework learns a multimodal mixture representation for each category, and performs dense predictions based on cosine distances between the pixels' deep embeddings and the category representations. The multimodal representations effectively utilize the inter-subject similarities and intraclass variations to overcome overfitting due to extremely limited data. In addition, we propose adaptive mixing coefficients for the multimodal mixture distributions to adaptively emphasize the modes better suited to the current input. The representations are implicitly embedded as weights of the fc layer, such that the cosine distances can be computed efficiently via forward propagation. In our experiments on brain MRI and abdominal CT datasets, the proposed framework achieves superior performances for low-shot segmentation towards standard DNN-based (3D U-Net) and classical registration-based (ANTs) methods, e.g., achieving mean Dice coefficients of 81%/69% for brain tissue/abdominal multi-organ segmentation using a single training sample, as compared to 52%/31% and 72%/35% by the U-Net and ANTs, respectively.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
Few-shot Medical Image Segmentation via Cross-Reference Transformer

Yao Huang,Jianming Liu

2023-07-26

Abstract:Deep learning models have become the mainstream method for medical image segmentation, but they require a large manually labeled dataset for training and are difficult to extend to unseen categories. Few-shot segmentation(FSS) has the potential to address these challenges by learning new categories from a small number of labeled samples. The majority of the current methods employ a prototype learning architecture, which involves expanding support prototype vectors and concatenating them with query features to conduct conditional segmentation. However, such framework potentially focuses more on query features while may neglect the correlation between support and query features. In this paper, we propose a novel self-supervised few shot medical image segmentation network with Cross-Reference Transformer, which addresses the lack of interaction between the support image and the query image. We first enhance the correlation features between the support set image and the query image using a bidirectional cross-attention module. Then, we employ a cross-reference mechanism to mine and enhance the similar parts of support features and query features in high-dimensional channels. Experimental results show that the proposed model achieves good results on both CT dataset and MRI dataset.

Image and Video Processing,Computer Vision and Pattern Recognition
Learning What Not to Segment: A New Perspective on Few-Shot Segmentation

Chunbo Lang,Gong Cheng,Binfei Tu,Junwei Han

DOI: https://doi.org/10.1109/cvpr52688.2022.00789

2022-01-01

Abstract:Recently few-shot segmentation (FSS) has been extensively developed. Most previous works strive to achieve generalization through the meta-learning framework derived from classification tasks; however, the trained models are biased towards the seen classes instead of being ideally class-agnostic, thus hindering the recognition of new concepts. This paper proposes a fresh and straightforward insight to alleviate the problem. Specifically, we apply an additional branch (base learner) to the conventional FSS model (meta learner) to explicitly identify the targets of base classes, i.e., the regions that do not need to be segmented. Then, the coarse results output by these two learners in parallel are adaptively integrated to yield precise segmentation prediction. Considering the sensitivity of meta learner, we further introduce an adjustment factor to estimate the scene differences between the input image pairs for facilitating the model ensemble forecasting. The substantial performance gains on PASCAL-5 i and COCO-20 i verify the effectiveness, and surprisingly, our versatile scheme sets a new state-of-the-art even with two plain learners. Moreover, in light of the unique nature of the proposed approach, we also extend it to a more realistic but challenging setting, i.e., generalized FSS, where the pixels of both base and novel classes are required to be determined. The source code is available at github.com/chunbolang/BAM.
OneSeg: Self-learning and One-shot Learning based Single-slice Annotation for 3D Medical Image Segmentation

Yixuan Wu,Bo Zheng,Jintai Chen,Danny Z. Chen,Jian Wu

2023-09-24

Abstract:As deep learning methods continue to improve medical image segmentation performance, data annotation is still a big bottleneck due to the labor-intensive and time-consuming burden on medical experts, especially for 3D images. To significantly reduce annotation efforts while attaining competitive segmentation accuracy, we propose a self-learning and one-shot learning based framework for 3D medical image segmentation by annotating only one slice of each 3D image. Our approach takes two steps: (1) self-learning of a reconstruction network to learn semantic correspondence among 2D slices within 3D images, and (2) representative selection of single slices for one-shot manual annotation and propagating the annotated data with the well-trained reconstruction network. Extensive experiments verify that our new framework achieves comparable performance with less than 1% annotated data compared with fully supervised methods and generalizes well on several out-of-distribution testing sets.

Computer Vision and Pattern Recognition
Retrieval-augmented Few-shot Medical Image Segmentation with Foundation Models

Lin Zhao,Xiao Chen,Eric Z. Chen,Yikang Liu,Terrence Chen,Shanhui Sun

2024-08-16

Abstract:Medical image segmentation is crucial for clinical decision-making, but the scarcity of annotated data presents significant challenges. Few-shot segmentation (FSS) methods show promise but often require retraining on the target domain and struggle to generalize across different modalities. Similarly, adapting foundation models like the Segment Anything Model (SAM) for medical imaging has limitations, including the need for finetuning and domain-specific adaptation. To address these issues, we propose a novel method that adapts DINOv2 and Segment Anything Model 2 (SAM 2) for retrieval-augmented few-shot medical image segmentation. Our approach uses DINOv2's feature as query to retrieve similar samples from limited annotated data, which are then encoded as memories and stored in memory bank. With the memory attention mechanism of SAM 2, the model leverages these memories as conditions to generate accurate segmentation of the target image. We evaluated our framework on three medical image segmentation tasks, demonstrating superior performance and generalizability across various modalities without the need for any retraining or finetuning. Overall, this method offers a practical and effective solution for few-shot medical image segmentation and holds significant potential as a valuable annotation tool in clinical applications.

Computer Vision and Pattern Recognition
Few-shot image segmentation for cross-institution male pelvic organs using registration-assisted prototypical learning

Yiwen Li,Yunguan Fu,Qianye Yang,Zhe Min,Wen Yan,Henkjan Huisman,Dean Barratt,Victor Adrian Prisacariu,Yipeng Hu

DOI: https://doi.org/10.48550/arXiv.2201.06358

2022-01-17

Abstract:The ability to adapt medical image segmentation networks for a novel class such as an unseen anatomical or pathological structure, when only a few labelled examples of this class are available from local healthcare providers, is sought-after. This potentially addresses two widely recognised limitations in deploying modern deep learning models to clinical practice, expertise-and-labour-intensive labelling and cross-institution generalisation. This work presents the first 3D few-shot interclass segmentation network for medical images, using a labelled multi-institution dataset from prostate cancer patients with eight regions of interest. We propose an image alignment module registering the predicted segmentation of both query and support data, in a standard prototypical learning algorithm, to a reference atlas space. The built-in registration mechanism can effectively utilise the prior knowledge of consistent anatomy between subjects, regardless whether they are from the same institution or not. Experimental results demonstrated that the proposed registration-assisted prototypical learning significantly improved segmentation accuracy (p-values<0.01) on query data from a holdout institution, with varying availability of support data from multiple institutions. We also report the additional benefits of the proposed 3D networks with 75% fewer parameters and an arguably simpler implementation, compared with existing 2D few-shot approaches that segment 2D slices of volumetric medical images.

Image and Video Processing,Computer Vision and Pattern Recognition
ADNet++: A few-shot learning framework for multi-class medical image volume segmentation with uncertainty-guided feature refinement

Stine Hansen,Srishti Gautam,Suaiba Amina Salahuddin,Michael Kampffmeyer,Robert Jenssen

DOI: https://doi.org/10.1016/j.media.2023.102870

Abstract:A major barrier to applying deep segmentation models in the medical domain is their typical data-hungry nature, requiring experts to collect and label large amounts of data for training. As a reaction, prototypical few-shot segmentation (FSS) models have recently gained traction as data-efficient alternatives. Nevertheless, despite the recent progress of these models, they still have some essential shortcomings that must be addressed. In this work, we focus on three of these shortcomings: (i) the lack of uncertainty estimation, (ii) the lack of a guiding mechanism to help locate edges and encourage spatial consistency in the segmentation maps, and (iii) the models' inability to do one-step multi-class segmentation. Without modifying or requiring a specific backbone architecture, we propose a modified prototype extraction module that facilitates the computation of uncertainty maps in prototypical FSS models, and show that the resulting maps are useful indicators of the model uncertainty. To improve the segmentation around boundaries and to encourage spatial consistency, we propose a novel feature refinement module that leverages structural information in the input space to help guide the segmentation in the feature space. Furthermore, we demonstrate how uncertainty maps can be used to automatically guide this feature refinement. Finally, to avoid ambiguous voxel predictions that occur when images are segmented class-by-class, we propose a procedure to perform one-step multi-class FSS. The efficiency of our proposed methodology is evaluated on two representative datasets for abdominal organ segmentation (CHAOS dataset and BTCV dataset) and one dataset for cardiac segmentation (MS-CMRSeg dataset). The results show that our proposed methodology significantly (one-sided Wilcoxon signed rank test, p<0.05) improves the baseline, increasing the overall dice score with +5.2, +5.1, and +2.8 percentage points for the CHAOS dataset, the BTCV dataset, and the MS-CMRSeg dataset, respectively.
Distillation Learning Guided by Image Reconstruction for One-Shot Medical Image Segmentation

Feng Zhou,Yanjie Zhou,Longjie Wang,Yun Peng,David E. Carlson,Liyun Tu

2024-08-07

Abstract:Traditional one-shot medical image segmentation (MIS) methods use registration networks to propagate labels from a reference atlas or rely on comprehensive sampling strategies to generate synthetic labeled data for training. However, these methods often struggle with registration errors and low-quality synthetic images, leading to poor performance and generalization. To overcome this, we introduce a novel one-shot MIS framework based on knowledge distillation, which allows the network to directly 'see' real images through a distillation process guided by image reconstruction. It focuses on anatomical structures in a single labeled image and a few unlabeled ones. A registration-based data augmentation network creates realistic, labeled samples, while a feature distillation module helps the student network learn segmentation from these samples, guided by the teacher network. During inference, the streamlined student network accurately segments new images. Evaluations on three public datasets (OASIS for T1 brain MRI, BCV for abdomen CT, and VerSe for vertebrae CT) show superior segmentation performance and generalization across different medical image datasets and modalities compared to leading methods. Our code is available at <a class="link-external link-https" href="https://github.com/NoviceFodder/OS-MedSeg" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
Self-supervised Learning based Transformer and Convolution Hybrid Network for one-shot Organ Segmentation

Bo Wang,Qian Li,Zheng You

DOI: https://doi.org/10.1016/j.neucom.2022.12.028

IF: 6

2022-12-24

Neurocomputing

Abstract:Few-shot medical segmentation aims at segmenting the desired regions from the input medical imaging data with only a pre-annotated example as the reference. By using the minimal annotation data to facilitate the segmentation, the few-shot manner receives great attention in the medial image analysis community due to its weak requirement on human annotation. For one-shot segmentation methods, one core issue is to learn a feature embedding space where the features of the desired segmentation regions on the unlabeled image and the references are high correlation. Previous works rely on the similarity between image features as a constraint to establish such embedding space, ignoring the correlation between samples mined from image features. To address this issue, we propose a novel transformer and convolution hybrid network for building the global correlation between the reference sample (support) and the desired segmentation sample (query). The convolution network is first to extract the local features of the support and query, then, the transformer further extracts the global features from the local feature space. To build the global correction between the support and query, we proposed a semantic dependency relationship embedding which introduces the channel-wise and spatial-wise co-information of them to the transformer. We employ superpixel-based self-supervised learning to train the proposed network to solve the problem of insufficient training samples in the field of medical image segmentation. Comprehensive experiments on two benchmarks demonstrate the superior capacity of the proposed approach when compared to the current alternatives and baseline models.

computer science, artificial intelligence
A novel medical image segmentation approach by using multi-branch segmentation network based on local and global information synchronous learning

Shangzhu Jin,Sheng Yu,Jun Peng,Hongyi Wang,Yan Zhao

DOI: https://doi.org/10.1038/s41598-023-33357-y

IF: 4.6

2023-04-27

Scientific Reports

Abstract:In recent years, there have been several solutions to medical image segmentation, such as U-shaped structure, transformer-based network, and multi-scale feature learning method. However, their network parameters and real-time performance are often neglected and cannot segment boundary regions well. The main reason is that such networks have deep encoders, a large number of channels, and excessive attention to local information rather than global information, which is crucial to the accuracy of image segmentation. Therefore, we propose a novel multi-branch medical image segmentation network MBSNet. We first design two branches using a parallel residual mixer (PRM) module and dilate convolution block to capture the local and global information of the image. At the same time, a SE-Block and a new spatial attention module enhance the output features. Considering the different output features of the two branches, we adopt a cross-fusion method to effectively combine and complement the features between different layers. MBSNet was tested on five datasets ISIC2018, Kvasir, BUSI, COVID-19, and LGG. The combined results show that MBSNet is lighter, faster, and more accurate. Specifically, for a input, MBSNet's FLOPs is 10.68 G , with an F1-Score of on the Kvasir test dataset, well above for UNet++ with FLOPs of 216.55 G . We also use the multi-criteria decision making method TOPSIS based on F1-Score, IOU and Geometric-Mean (G-mean) for overall analysis. The proposed MBSNet model performs better than other competitive methods. Code is available at https://github.com/YuLionel/MBSNet.

multidisciplinary sciences
Attentional adversarial training for few-shot medical image segmentation without annotations

Buhailiqiemu Awudong,Qi Li,Zili Liang,Lin Tian,Jingwen Yan

DOI: https://doi.org/10.1371/journal.pone.0298227

IF: 3.7

2024-05-02

PLoS ONE

Abstract:Medical image segmentation is a critical application that plays a significant role in clinical research. Despite the fact that many deep neural networks have achieved quite high accuracy in the field of medical image segmentation, there is still a scarcity of annotated labels, making it difficult to train a robust and generalized model. Few-shot learning has the potential to predict new classes that are unseen in training with a few annotations. In this study, a novel few-shot semantic segmentation framework named prototype-based generative adversarial network (PG-Net) is proposed for medical image segmentation without annotations. The proposed PG-Net consists of two subnetworks: the prototype-based segmentation network (P-Net) and the guided evaluation network (G-Net). On one hand, the P-Net as a generator focuses on extracting multi-scale features and local spatial information in order to produce refined predictions with discriminative context between foreground and background. On the other hand, the G-Net as a discriminator, which employs an attention mechanism, further distills the relation knowledge between support and query, and contributes to P-Net producing segmentation masks of query with more similar distributions as support. Hence, the PG-Net can enhance segmentation quality by an adversarial training strategy. Compared to the state-of-the-art (SOTA) few-shot segmentation methods, comparative experiments demonstrate that the proposed PG-Net provides noticeably more robust and prominent generalization ability on different medical image modality datasets, including an abdominal Computed Tomography (CT) dataset and an abdominal Magnetic Resonance Imaging (MRI) dataset.
DenseMP: Unsupervised Dense Pre-training for Few-shot Medical Image Segmentation.

Zhaoxin Fan,Puquan Pan,Zeren Zhang,Ce Chen,Tianyang Wang,Siyang Zheng,Min Xu

DOI: https://doi.org/10.48550/arxiv.2307.09604

2023-01-01

Abstract:Few-shot medical image semantic segmentation is of paramount importance in the domain of medical image analysis. However, existing methodologies grapple with the challenge of data scarcity during the training phase, leading to over-fitting. To mitigate this issue, we introduce a novel Unsupervised Dense Few-shot Medical Image Segmentation Model Training Pipeline (DenseMP) that capitalizes on unsupervised dense pre-training. DenseMP is composed of two distinct stages: (1) segmentation-aware dense contrastive pre-training, and (2) few-shot-aware superpixel guided dense pre-training. These stages collaboratively yield a pre-trained initial model specifically designed for few-shot medical image segmentation, which can subsequently be fine-tuned on the target dataset. Our proposed pipeline significantly enhances the performance of the widely recognized few-shot segmentation model, PA-Net, achieving state-of-the-art results on the Abd-CT and Abd-MRI datasets. Code will be released after acceptance.
Dual-Guided Prototype Alignment Network for Few-Shot Medical Image Segmentation

Yue Shen,Wanshu Fan,Cong Wang,Wenfei Liu,Wei Wang,Qiang Zhang,Dongsheng Zhou

DOI: https://doi.org/10.1109/tim.2024.3411136

IF: 5.6

2024-06-21

IEEE Transactions on Instrumentation and Measurement

Abstract:Given the hurdles of limited data availability, annotation challenges, and constrained generalization capabilities in medical image segmentation, few-shot learning (FSL) has become a prominent approach due to its efficacy in learning new categories from minimal annotated samples. Existing methods predominantly adopt the support-guided paradigm, wherein support prototypes, derived from annotated support images, guide the segmentation of unlabeled query images. This approach, however, is prone to local information loss and classification bias. To counter these challenges, we introduce a novel dual-guided prototype alignment network (DGPANet) that integrates a bidirectional segmentation architecture. The support-to-query branch incorporates query guidance information into the conventional support-guided approach for segmenting query images, whereas the complementary query-to-support branch segments support images in reverse with the dual guidance provided. This design not only optimizes our network but also alleviates segmentation biases pertaining to support category objects. Furthermore, we propose an adaptive prototype module (APM) to foster information amalgamation by adaptively clustering analogous elements. Moreover, we propose an adaptive prototype alignment loss to better improve the dual optimization (DO) procedure. Extensive experiments show that our proposed DGPANet favors against state-of-the-art (SOTA) approaches on three public datasets, including abdominal-computed tomography (CT), abdominal-magnetic resonance imaging (MRI), and Cardiac-MRI. Codes are at https://github.com/shiyi0306/DGPANet.

engineering, electrical & electronic,instruments & instrumentation

Autoprotective mechanisms in the CNS: some new lessons from white matter.

Recurrent Mask Refinement for Few-Shot Medical Image Segmentation

Few-Shot Medical Image Segmentation with Large Kernel Attention

Few-shot Medical Image Segmentation with Cycle-resemblance Attention

Few Shot Medical Image Segmentation with Cross Attention Transformer

'Squeeze & Excite' Guided Few-Shot Segmentation of Volumetric Images

Bidirectional RNN-based Few Shot Learning for 3D Medical Image Segmentation

A Unified Framework for Generalized Low-Shot Medical Image Segmentation With Scarce Data

Few-shot Medical Image Segmentation via Cross-Reference Transformer

Learning What Not to Segment: A New Perspective on Few-Shot Segmentation

OneSeg: Self-learning and One-shot Learning based Single-slice Annotation for 3D Medical Image Segmentation

Retrieval-augmented Few-shot Medical Image Segmentation with Foundation Models

Few-shot image segmentation for cross-institution male pelvic organs using registration-assisted prototypical learning

ADNet++: A few-shot learning framework for multi-class medical image volume segmentation with uncertainty-guided feature refinement

Distillation Learning Guided by Image Reconstruction for One-Shot Medical Image Segmentation

Self-supervised Learning based Transformer and Convolution Hybrid Network for one-shot Organ Segmentation

A novel medical image segmentation approach by using multi-branch segmentation network based on local and global information synchronous learning

Attentional adversarial training for few-shot medical image segmentation without annotations

DenseMP: Unsupervised Dense Pre-training for Few-shot Medical Image Segmentation.

Dual-Guided Prototype Alignment Network for Few-Shot Medical Image Segmentation