Consultation-liaison psychiatry and Dr. James Eaton.

T. Wise

DOI: https://doi.org/10.1016/S0033-3182(83)73202-0

1983-05-01

Psychosomatics

Abstract:

What problem does this paper attempt to address?

Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective

Chenyu You,Weicheng Dai,Yifei Min,Fenglin Liu,David A. Clifton,S Kevin Zhou,Lawrence Hamilton Staib,James S Duncan

2023-10-24

Abstract:For medical image segmentation, contrastive learning is the dominant practice to improve the quality of visual representations by contrasting semantically similar and dissimilar pairs of samples. This is enabled by the observation that without accessing ground truth labels, negative examples with truly dissimilar anatomical features, if sampled, can significantly improve the performance. In reality, however, these samples may come from similar anatomical regions and the models may struggle to distinguish the minority tail-class samples, making the tail classes more prone to misclassification, both of which typically lead to model collapse. In this paper, we propose ARCO, a semi-supervised contrastive learning (CL) framework with stratified group theory for medical image segmentation. In particular, we first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks with extremely limited labels. Furthermore, we theoretically prove these sampling techniques are universal in variance reduction. Finally, we experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings, and our methods consistently outperform state-of-the-art semi-supervised methods. Additionally, we augment the CL frameworks with these sampling techniques and demonstrate significant gains over previous methods. We believe our work is an important step towards semi-supervised medical image segmentation by quantifying the limitation of current self-supervision objectives for accomplishing such challenging safety-critical tasks.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning,Image and Video Processing
Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

Qing Liu Sun,Hailong Zeng,Zhaodong Sun,Xiaobai Li,Guoying Zhao,Yixiong Liang

DOI: https://doi.org/10.1016/j.patcog.2024.110636

IF: 8

2024-01-01

Pattern Recognition

Abstract:Medical image segmentation is fundamental in the field of medical image analysis and has wide clinical applications in disease diagnosis and surgical planning etc. Current prevalent solution is to train a deep network in a fully supervised way with a large-scale fully labeled dataset. However, due to the high labor cost and requirement on medical expertise, such dataset is always absent. Instead, there are multiple partially labeled datasets which are originally established for specific purposes. To make full use of these partially labeled datasets, we propose a novel partially supervised segmentation network, named PSSNet, which consists of a task-specific feature learning network followed by a cross-task attention module (xTA) to exploit task dependencies to enhance task-specific features. To solve the challenges raised by unlabeled classes and domain shift across datasets, we propose an adversarial self-training strategy. We conduct experiments on two medical image segmentation tasks. One is the fine-grained fundus image segmentation aiming to simultaneously segment four-class lesions, OD and OC, and vessels. Validation on seven datasets demonstrates that our PSSNet performs the best among three baselines and three state-of-the-arts. The other is the multiple abdominal organ segmentation in CT images. Our PSSNet is trained on three partially labeled datasets, i.e., LiTS, KiTS and Spleen. Validation on one fully labeled dataset, i.e., BTCV, demonstrates that our PSSNet achieves better performances than four state-of-the-arts. The code is publicly available at https://github.com/CVIUCSU/PSSNet.
OneSeg: Self-learning and One-shot Learning based Single-slice Annotation for 3D Medical Image Segmentation

Yixuan Wu,Bo Zheng,Jintai Chen,Danny Z. Chen,Jian Wu

2023-09-24

Abstract:As deep learning methods continue to improve medical image segmentation performance, data annotation is still a big bottleneck due to the labor-intensive and time-consuming burden on medical experts, especially for 3D images. To significantly reduce annotation efforts while attaining competitive segmentation accuracy, we propose a self-learning and one-shot learning based framework for 3D medical image segmentation by annotating only one slice of each 3D image. Our approach takes two steps: (1) self-learning of a reconstruction network to learn semantic correspondence among 2D slices within 3D images, and (2) representative selection of single slices for one-shot manual annotation and propagating the annotated data with the well-trained reconstruction network. Extensive experiments verify that our new framework achieves comparable performance with less than 1% annotated data compared with fully supervised methods and generalizes well on several out-of-distribution testing sets.

Computer Vision and Pattern Recognition
Manifold-Aware Local Feature Modeling for Semi-Supervised Medical Image Segmentation

Sicheng Shen,Jinming Cao,Yifang Yin,Roger Zimmermann

2024-10-14

Abstract:Achieving precise medical image segmentation is vital for effective treatment planning and accurate disease diagnosis. Traditional fully-supervised deep learning methods, though highly precise, are heavily reliant on large volumes of labeled data, which are often difficult to obtain due to the expertise required for medical annotations. This has led to the rise of semi-supervised learning approaches that utilize both labeled and unlabeled data to mitigate the label scarcity issue. In this paper, we introduce the Manifold-Aware Local Feature Modeling Network (MANet), which enhances the U-Net architecture by incorporating manifold supervision signals. This approach focuses on improving boundary accuracy, which is crucial for reliable medical diagnosis. To further extend the versatility of our method, we propose two variants: MA-Sobel and MA-Canny. The MA-Sobel variant employs the Sobel operator, which is effective for both 2D and 3D data, while the MA-Canny variant utilizes the Canny operator, specifically designed for 2D images, to refine boundary detection. These variants allow our method to adapt to various medical image modalities and dimensionalities, ensuring broader applicability. Our extensive experiments on datasets such as ACDC, LA, and Pancreas-NIH demonstrate that MANet consistently surpasses state-of-the-art methods in performance metrics like Dice and Jaccard scores. The proposed method also shows improved generalization across various semi-supervised segmentation networks, highlighting its robustness and effectiveness. Visual analysis of segmentation results confirms that MANet offers clearer and more accurate class boundaries, underscoring the value of manifold information in medical image segmentation.

Computer Vision and Pattern Recognition
Leveraging Unlabeled Data for 3D Medical Image Segmentation through Self-Supervised Contrastive Learning

Sanaz Karimijafarbigloo,Reza Azad,Yury Velichko,Ulas Bagci,Dorit Merhof

2023-11-21

Abstract:Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these challenges, we introduce two distinct subnetworks designed to explore and exploit the discrepancies between them, ultimately correcting the erroneous prediction results. More specifically, we identify regions of inconsistent predictions and initiate a targeted verification training process. This procedure strategically fine-tunes and harmonizes the predictions of the subnetworks, leading to enhanced utilization of contextual information. Furthermore, to adaptively fine-tune the network's representational capacity and reduce prediction uncertainty, we employ a self-supervised contrastive learning paradigm. For this, we use the network's confidence to distinguish between reliable and unreliable predictions. The model is then trained to effectively minimize unreliable predictions. Our experimental results for organ segmentation, obtained from clinical MRI and CT scans, demonstrate the effectiveness of our approach when compared to state-of-the-art methods. The codebase is accessible on \href{<a class="link-external link-https" href="https://github.com/xmindflow/SSL-contrastive" rel="external noopener nofollow">this https URL</a>}{GitHub}.

Computer Vision and Pattern Recognition
Enhanced synthesis of adrenal dopamine beta-hydroxylase induced by repeated immobilization in rats.

R. Květňanský,G. Gewirtz,V. Weise,I. Kopin

Molecular Pharmacology

Abstract:Repeated immobilization of rats results in a striking increase in adrenal medullary dopamine β-hydroxylase activity. After six periods of immobilization the levels are highest preceding the next immobilization, decrease during the immobilization, and increase upon termination of the immobilization. Six hours after the immobilization the activities return nearly to the preimmobilization levels. Denervation of the adrenal markedly diminishes the increase in dopamine β-hydroxylase activity that occurs with repeated immobilization. Prior treatment with hexamethonium prevents the decrease in activity during the immobilization interval, whereas the protein synthesis inhibitors actinomycin D and cycloheximide prevent the increase in enzyme activity seen after termination of immobilization. These observations support the view that dopamine β-hydroxylase is released as a result of neural stimulationn during immobilization and suggest that its increase following cessation of immobilization is a consequence of accelerated synthesis of the enzyme.
MONAI Label: A framework for AI-assisted interactive labeling of 3D medical images

Andres Diaz-Pinto,Sachidanand Alle,Vishwesh Nath,Yucheng Tang,Alvin Ihsani,Muhammad Asad,Fernando Pérez-García,Pritesh Mehta,Wenqi Li,Mona Flores,Holger R Roth,Tom Vercauteren,Daguang Xu,Prerna Dogra,Sebastien Ourselin,Andrew Feng,M Jorge Cardoso

DOI: https://doi.org/10.1016/j.media.2024.103207

Abstract:The lack of annotated datasets is a major bottleneck for training new task-specific supervised machine learning models, considering that manual annotation is extremely expensive and time-consuming. To address this problem, we present MONAI Label, a free and open-source framework that facilitates the development of applications based on artificial intelligence (AI) models that aim at reducing the time required to annotate radiology datasets. Through MONAI Label, researchers can develop AI annotation applications focusing on their domain of expertise. It allows researchers to readily deploy their apps as services, which can be made available to clinicians via their preferred user interface. Currently, MONAI Label readily supports locally installed (3D Slicer) and web-based (OHIF) frontends and offers two active learning strategies to facilitate and speed up the training of segmentation algorithms. MONAI Label allows researchers to make incremental improvements to their AI-based annotation application by making them available to other researchers and clinicians alike. Additionally, MONAI Label provides sample AI-based interactive and non-interactive labeling applications, that can be used directly off the shelf, as plug-and-play to any given dataset. Significant reduced annotation times using the interactive model can be observed on two public datasets.
PA-Seg: Learning from Point Annotations for 3D Medical Image Segmentation using Contextual Regularization and Cross Knowledge Distillation

Shuwei Zhai,Guotai Wang,Xiangde Luo,Qiang Yue,Kang Li,Shaoting Zhang

DOI: https://doi.org/10.1109/tmi.2023.3245068

IF: 10.6

2023-01-01

IEEE Transactions on Medical Imaging

Abstract:The success of Convolutional Neural Networks (CNNs) in 3D medical image segmentation relies on massive fully annotated 3D volumes for training that are time-consuming and labor-intensive to acquire. In this paper, we propose to annotate a segmentation target with only seven points in 3D medical images, and design a two-stage weakly supervised learning framework PA-Seg. In the first stage, we employ geodesic distance transform to expand the seed points to provide more supervision signal. To further deal with unannotated image regions during training, we propose two contextual regularization strategies, i.e., multi-view Conditional Random Field (mCRF) loss and Variance Minimization (VM) loss, where the first one encourages pixels with similar features to have consistent labels, and the second one minimizes the intensity variance for the segmented foreground and background, respectively. In the second stage, we use predictions obtained by the model pre-trained in the first stage as pseudo labels. To overcome noises in the pseudo labels, we introduce a Self and Cross Monitoring (SCM) strategy, which combines self-training with Cross Knowledge Distillation (CKD) between a primary model and an auxiliary model that learn from soft labels generated by each other. Experiments on public datasets for Vestibular Schwannoma (VS) segmentation and Brain Tumor Segmentation (BraTS) demonstrated that our model trained in the first stage outperformed existing state-of-the-art weakly supervised approaches by a large margin, and after using SCM for additional training, the model's performance was close to its fully supervised counterpart on the BraTS dataset.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
Orthogonal Annotation Benefits Barely-supervised Medical Image Segmentation

Heng Cai,Shumeng Li,Lei Qi,Qian Yu,Yinghuan Shi,Yang Gao

2023-03-23

Abstract:Recent trends in semi-supervised learning have significantly boosted the performance of 3D semi-supervised medical image segmentation. Compared with 2D images, 3D medical volumes involve information from different directions, e.g., transverse, sagittal, and coronal planes, so as to naturally provide complementary views. These complementary views and the intrinsic similarity among adjacent 3D slices inspire us to develop a novel annotation way and its corresponding semi-supervised model for effective segmentation. Specifically, we firstly propose the orthogonal annotation by only labeling two orthogonal slices in a labeled volume, which significantly relieves the burden of annotation. Then, we perform registration to obtain the initial pseudo labels for sparsely labeled volumes. Subsequently, by introducing unlabeled volumes, we propose a dual-network paradigm named Dense-Sparse Co-training (DeSCO) that exploits dense pseudo labels in early stage and sparse labels in later stage and meanwhile forces consistent output of two networks. Experimental results on three benchmark datasets validated our effectiveness in performance and efficiency in annotation. For example, with only 10 annotated slices, our method reaches a Dice up to 86.93% on KiTS19 dataset.

Computer Vision and Pattern Recognition
An Annotation Sparsification Strategy for 3D Medical Image Segmentation via Representative Selection and Self-Training

Hao Zheng,Yizhe Zhang,Lin Yang,Chaoli Wang,Danny Z Chen

DOI: https://doi.org/10.1609/aaai.v34i04.6175

Abstract:Image segmentation is critical to lots of medical applications. While deep learning (DL) methods continue to improve performance for many medical image segmentation tasks, data annotation is a big bottleneck to DL-based segmentation because (1) DL models tend to need a large amount of labeled data to train, and (2) it is highly time-consuming and label-intensive to voxel-wise label 3D medical images. Significantly reducing annotation effort while attaining good performance of DL segmentation models remains a major challenge. In our preliminary experiments, we observe that, using partially labeled datasets, there is indeed a large performance gap with respect to using fully annotated training datasets. In this paper, we propose a new DL framework for reducing annotation effort and bridging the gap between full annotation and sparse annotation in 3D medical image segmentation. We achieve this by (i) selecting representative slices in 3D images that minimize data redundancy and save annotation effort, and (ii) self-training with pseudo-labels automatically generated from the base-models trained using the selected annotated slices. Extensive experiments using two public datasets (the HVSMR 2016 Challenge dataset and mouse piriform cortex dataset) show that our framework yields competitive segmentation results comparing with state-of-the-art DL methods using less than ~ 20% of annotated data.
Few-Shot Medical Image Segmentation with Large Kernel Attention

Xiaoxiao Wu,Xiaowei Chen,Zhenguo Gao,Shulei Qu,Yuanyuan Qiu

2024-07-27

Abstract:Medical image segmentation has witnessed significant advancements with the emergence of deep learning. However, the reliance of most neural network models on a substantial amount of annotated data remains a challenge for medical image segmentation. To address this issue, few-shot segmentation methods based on meta-learning have been employed. Presently, the methods primarily focus on aligning the support set and query set to enhance performance, but this approach hinders further improvement of the model's effectiveness. In this paper, our objective is to propose a few-shot medical segmentation model that acquire comprehensive feature representation capabilities, which will boost segmentation accuracy by capturing both local and long-range features. To achieve this, we introduce a plug-and-play attention module that dynamically enhances both query and support features, thereby improving the representativeness of the extracted features. Our model comprises four key modules: a dual-path feature extractor, an attention module, an adaptive prototype prediction module, and a multi-scale prediction fusion module. Specifically, the dual-path feature extractor acquires multi-scale features by obtaining features of 32{\times}32 size and 64{\times}64 size. The attention module follows the feature extractor and captures local and long-range information. The adaptive prototype prediction module automatically adjusts the anomaly score threshold to predict prototypes, while the multi-scale fusion prediction module integrates prediction masks of various scales to produce the final segmentation result. We conducted experiments on publicly available MRI datasets, namely CHAOS and CMR, and compared our method with other advanced techniques. The results demonstrate that our method achieves state-of-the-art performance.

Computer Vision and Pattern Recognition
Shape and boundary-aware multi-branch model for semi-supervised medical image segmentation

Xiaowei Liu,Yikun Hu,Jianguo Chen,Keqin Li

DOI: https://doi.org/10.1016/j.compbiomed.2022.105252

Abstract:Supervised learning-based medical image segmentation solutions usually require sufficient labeled training data. Insufficient available labeled training data often leads to the limitations of model performances, such as over-fitting, low accuracy, and poor generalization ability. However, this dilemma may worsen in the field of medical image analysis. Medical image annotation is usually labor-intensive and professional work. In this work, we propose a novel shape and boundary-aware deep learning model for medical image segmentation based on semi-supervised learning. The model makes good use of labeled data and also enables unlabeled data to be well applied by using task consistency loss. Firstly, we adopt V-Net for Pixel-wise Segmentation Map (PSM) prediction and Signed Distance Map (SDM) regression. In addition, we multiply multi-scale features, extracted by Pyramid Pooling Module (PPM) from input X, with 2 - |SDM| to enhance the features around the boundary of the segmented target, and then feed them into the Feature Fusion Module (FFM) for fine segmentation. Besides boundary loss, the high-level semantics implied in SDM facilitate the accurate segmentation of boundary regions. Finally, we get the ultimate result by fusing coarse and boundary-enhanced features. Last but not least, to mine unlabeled training data, we impose consistency constraints on the three core outputs of the model, namely PSM1, SDM, and PSM3. Through extensive experiments over three representative but challenging medical image datasets (LA2018, BraTS2019, and ISIC2018) and comparisons with the existing representative methods, we validate the practicability and superiority of our model.
Transformation Consistent Self-ensembling Model for Semi-supervised Medical Image Segmentation

Xiaomeng Li,Lequan Yu,Hao Chen,Chi-Wing Fu,Lei Xing,Pheng-Ann Heng

DOI: https://doi.org/10.48550/arXiv.1903.00348

2019-02-28

Computer Vision and Pattern Recognition

Abstract:Deep convolutional neural networks have achieved remarkable progress on a variety of medical image computing tasks. A common problem when applying supervised deep learning methods to medical images is the lack of labeled data, which is very expensive and time-consuming to be collected. In this paper, we present a novel semi-supervised method for medical image segmentation, where the network is optimized by the weighted combination of a common supervised loss for labeled inputs only and a regularization loss for both labeled and unlabeled data. To utilize the unlabeled data, our method encourages the consistent predictions of the network-in-training for the same input under different regularizations. Aiming for the semi-supervised segmentation problem, we enhance the effect of regularization for pixel-level predictions by introducing a transformation, including rotation and flipping, consistent scheme in our self-ensembling model. With the aim of semi-supervised segmentation tasks, we introduce a transformation consistent strategy in our self-ensembling model to enhance the regularization effect for pixel-level predictions. We have extensively validated the proposed semi-supervised method on three typical yet challenging medical image segmentation tasks: (i) skin lesion segmentation from dermoscopy images on International Skin Imaging Collaboration (ISIC) 2017 dataset, (ii) optic disc segmentation from fundus images on Retinal Fundus Glaucoma Challenge (REFUGE) dataset, and (iii) liver segmentation from volumetric CT scans on Liver Tumor Segmentation Challenge (LiTS) dataset. Compared to the state-of-the-arts, our proposed method shows superior segmentation performance on challenging 2D/3D medical images, demonstrating the effectiveness of our semi-supervised method for medical image segmentation.
A sparse annotation strategy based on attention-guided active learning for 3D medical image segmentation

Zhenxi Zhang,Jie Li,Zhusi Zhong,Zhicheng Jiao,Xinbo Gao

DOI: https://doi.org/10.48550/arXiv.1906.07367

2019-06-18

Computer Vision and Pattern Recognition

Abstract:3D image segmentation is one of the most important and ubiquitous problems in medical image processing. It provides detailed quantitative analysis for accurate disease diagnosis, abnormal detection, and classification. Currently deep learning algorithms are widely used in medical image segmentation, most algorithms trained models with full annotated datasets. However, obtaining medical image datasets is very difficult and expensive, and full annotation of 3D medical image is a monotonous and time-consuming work. Partially labelling informative slices in 3D images will be a great relief of manual annotation. Sample selection strategies based on active learning have been proposed in the field of 2D image, but few strategies focus on 3D images. In this paper, we propose a sparse annotation strategy based on attention-guided active learning for 3D medical image segmentation. Attention mechanism is used to improve segmentation accuracy and estimate the segmentation accuracy of each slice. The comparative experiments with three different strategies using datasets from the developing human connectome project (dHCP) show that, our strategy only needs 15% to 20% annotated slices in brain extraction task and 30% to 35% annotated slices in tissue segmentation task to achieve comparative results as full annotation.
Positional Information is a Strong Supervision for Volumetric Medical Image Segmentation

Yinjie Zhao,Runping Hou,Wanqin Zeng,Yulei Qin,Tianle Shen,Zhiyong Xu,Xiaolong Fu,Hongbin Shen

DOI: https://doi.org/10.1007/s12204-023-2614-y

2023-01-01

Journal of Shanghai Jiaotong University (Science)

Abstract:Medical image segmentation is a crucial preliminary step for a number of downstream diagnosis tasks. As deep convolutional neural networks successfully promote the development of computer vision, it is possible to make medical image segmentation a semi-automatic procedure by applying deep convolutional neural networks to finding the contours of regions of interest that are then revised by radiologists. However, supervised learning necessitates large annotated data, which are difficult to acquire especially for medical images. Self-supervised learning is able to take advantage of unlabeled data and provide good initialization to be finetuned for downstream tasks with limited annotations. Considering that most self-supervised learning especially contrastive learning methods are tailored to natural image classification and entail expensive GPU resources, we propose a novel and simple pretext-based self-supervised learning method that exploits the value of positional information in volumetric medical images. Specifically, we regard spatial coordinates as pseudo labels and pretrain the model by predicting positions of randomly sampled 2D slices in volumetric medical images. Experiments on four semantic segmentation datasets demonstrate the superiority of our method over other self-supervised learning methods in both semi-supervised learning and transfer learning settings. Codes are available at https://github.com/alienzyj/PPos .
3D Medical Image Segmentation with Sparse Annotation via Cross-Teaching between 3D and 2D Networks

Heng Cai,Lei Qi,Qian Yu,Yinghuan Shi,Yang Gao

DOI: https://doi.org/10.48550/arXiv.2307.16256

2023-07-30

Abstract:Medical image segmentation typically necessitates a large and precisely annotated dataset. However, obtaining pixel-wise annotation is a labor-intensive task that requires significant effort from domain experts, making it challenging to obtain in practical clinical scenarios. In such situations, reducing the amount of annotation required is a more practical approach. One feasible direction is sparse annotation, which involves annotating only a few slices, and has several advantages over traditional weak annotation methods such as bounding boxes and scribbles, as it preserves exact boundaries. However, learning from sparse annotation is challenging due to the scarcity of supervision signals. To address this issue, we propose a framework that can robustly learn from sparse annotation using the cross-teaching of both 3D and 2D networks. Considering the characteristic of these networks, we develop two pseudo label selection strategies, which are hard-soft confidence threshold and consistent label fusion. Our experimental results on the MMWHS dataset demonstrate that our method outperforms the state-of-the-art (SOTA) semi-supervised segmentation methods. Moreover, our approach achieves results that are comparable to the fully-supervised upper bound result.

Computer Vision and Pattern Recognition
Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation

Xiaomeng Li,Lequan Yu,Hao Chen,Chi-Wing Fu,Lei Xing,Pheng-Ann Heng

DOI: https://doi.org/10.1109/tnnls.2020.2995319

IF: 14.255

2021-02-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:A common shortfall of supervised deep learning for medical imaging is the lack of labeled data, which is often expensive and time consuming to collect. This article presents a new semisupervised method for medical image segmentation, where the network is optimized by a weighted combination of a common supervised loss only for the labeled inputs and a regularization loss for both the labeled and unlabeled data. To utilize the unlabeled data, our method encourages consistent predictions of the network-in-training for the same input under different perturbations. With the semisupervised segmentation tasks, we introduce a transformation-consistent strategy in the self-ensembling model to enhance the regularization effect for pixel-level predictions. To further improve the regularization effects, we extend the transformation in a more generalized form including scaling and optimize the consistency loss with a teacher model, which is an averaging of the student model weights. We extensively validated the proposed semisupervised method on three typical yet challenging medical image segmentation tasks: 1) skin lesion segmentation from dermoscopy images in the International Skin Imaging Collaboration (ISIC) 2017 data set; 2) optic disk (OD) segmentation from fundus images in the Retinal Fundus Glaucoma Challenge (REFUGE) data set; and 3) liver segmentation from volumetric CT scans in the Liver Tumor Segmentation Challenge (LiTS) data set. Compared with state-of-the-art, our method shows superior performance on the challenging 2-D/3-D medical images, demonstrating the effectiveness of our semisupervised method for medical image segmentation.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
Segment Together: A Versatile Paradigm for Semi-Supervised Medical Image Segmentation

Qingjie Zeng,Yutong Xie,Zilin Lu,Mengkang Lu,Yicheng Wu,Yong Xia

2023-11-20

Abstract:Annotation scarcity has become a major obstacle for training powerful deep-learning models for medical image segmentation, restricting their deployment in clinical scenarios. To address it, semi-supervised learning by exploiting abundant unlabeled data is highly desirable to boost the model training. However, most existing works still focus on limited medical tasks and underestimate the potential of learning across diverse tasks and multiple datasets. Therefore, in this paper, we introduce a \textbf{Ver}satile \textbf{Semi}-supervised framework (VerSemi) to point out a new perspective that integrates various tasks into a unified model with a broad label space, to exploit more unlabeled data for semi-supervised medical image segmentation. Specifically, we introduce a dynamic task-prompted design to segment various targets from different datasets. Next, this unified model is used to identify the foreground regions from all labeled data, to capture cross-dataset semantics. Particularly, we create a synthetic task with a cutmix strategy to augment foreground targets within the expanded label space. To effectively utilize unlabeled data, we introduce a consistency constraint. This involves aligning aggregated predictions from various tasks with those from the synthetic task, further guiding the model in accurately segmenting foreground regions during training. We evaluated our VerSemi model on four public benchmarking datasets. Extensive experiments demonstrated that VerSemi can consistently outperform the second-best method by a large margin (e.g., an average 2.69\% Dice gain on four datasets), setting new SOTA performance for semi-supervised medical image segmentation. The code will be released.

Computer Vision and Pattern Recognition
Segmentation only uses sparse annotations: Unified weakly and semi-supervised learning in medical images

Feng Gao,Minhao Hu,Min-Er Zhong,Shixiang Feng,Xuwei Tian,Xiaochun Meng,Ma-yi-di-li Ni-jia-ti,Zeping Huang,Minyi Lv,Tao Song,Xiaofan Zhang,Xiaoguang Zou,Xiaojian Wu

DOI: https://doi.org/10.1016/j.media.2022.102515

IF: 10.9

2022-08-01

Medical Image Analysis

Abstract:Since segmentation labeling is usually time-consuming and annotating medical images requires professional expertise, it is laborious to obtain a large-scale, high-quality annotated segmentation dataset. We propose a novel weakly- and semi-supervised framework named SOUSA (Segmentation Only Uses Sparse Annotations), aiming at learning from a small set of sparse annotated data and a large amount of unlabeled data. The proposed framework contains a teacher model and a student model. The student model is weakly supervised by scribbles and a Geodesic distance map derived from scribbles. Meanwhile, a large amount of unlabeled data with various perturbations are fed to student and teacher models. The consistency of their output predictions is imposed by Mean Square Error (MSE) loss and a carefully designed Multi-angle Projection Reconstruction (MPR) loss. Extensive experiments are conducted to demonstrate the robustness and generalization ability of our proposed method. Results show that our method outperforms weakly- and semi-supervised state-of-the-art methods on multiple datasets. Furthermore, our method achieves a competitive performance with some fully supervised methods with dense annotation when the size of the dataset is limited.

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
Contrastive Semi-Supervised Learning for Domain Adaptive Segmentation Across Similar Anatomical Structures

Ran Gu,Jingyang Zhang,Guotai Wang,Wenhui Lei,Tao Song,Xiaofan Zhang,Kang Li,Shaoting Zhang

DOI: https://doi.org/10.1109/tmi.2022.3209798

IF: 10.6

2022-12-30

IEEE Transactions on Medical Imaging

Abstract:Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for medical image segmentation, yet need plenty of manual annotations for training. Semi-Supervised Learning (SSL) methods are promising to reduce the requirement of annotations, but their performance is still limited when the dataset size and the number of annotated images are small. Leveraging existing annotated datasets with similar anatomical structures to assist training has a potential for improving the model's performance. However, it is further challenged by the cross-anatomy domain shift due to the image modalities and even different organs in the target domain. To solve this problem, we propose Contrastive Semi-supervised learning for Cross Anatomy Domain Adaptation (CS-CADA) that adapts a model to segment similar structures in a target domain, which requires only limited annotations in the target domain by leveraging a set of existing annotated images of similar structures in a source domain. We use Domain-Specific Batch Normalization (DSBN) to individually normalize feature maps for the two anatomical domains, and propose a cross-domain contrastive learning strategy to encourage extracting domain invariant features. They are integrated into a Self-Ensembling Mean-Teacher (SE-MT) framework to exploit unlabeled target domain images with a prediction consistency constraint. Extensive experiments show that our CS-CADA is able to solve the challenging cross-anatomy domain shift problem, achieving accurate segmentation of coronary arteries in X-ray images with the help of retinal vessel images and cardiac MR images with the help of fundus images, respectively, given only a small number of annotations in the target domain. Our code is available at https://github.com/HiLab-git/DAG4MIA.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging

Consultation-liaison psychiatry and Dr. James Eaton.

Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective

Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

OneSeg: Self-learning and One-shot Learning based Single-slice Annotation for 3D Medical Image Segmentation

Manifold-Aware Local Feature Modeling for Semi-Supervised Medical Image Segmentation

Leveraging Unlabeled Data for 3D Medical Image Segmentation through Self-Supervised Contrastive Learning

Enhanced synthesis of adrenal dopamine beta-hydroxylase induced by repeated immobilization in rats.

MONAI Label: A framework for AI-assisted interactive labeling of 3D medical images

PA-Seg: Learning from Point Annotations for 3D Medical Image Segmentation using Contextual Regularization and Cross Knowledge Distillation

Orthogonal Annotation Benefits Barely-supervised Medical Image Segmentation

An Annotation Sparsification Strategy for 3D Medical Image Segmentation via Representative Selection and Self-Training

Few-Shot Medical Image Segmentation with Large Kernel Attention

Shape and boundary-aware multi-branch model for semi-supervised medical image segmentation

Transformation Consistent Self-ensembling Model for Semi-supervised Medical Image Segmentation

A sparse annotation strategy based on attention-guided active learning for 3D medical image segmentation

Positional Information is a Strong Supervision for Volumetric Medical Image Segmentation

3D Medical Image Segmentation with Sparse Annotation via Cross-Teaching between 3D and 2D Networks

Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation

Segment Together: A Versatile Paradigm for Semi-Supervised Medical Image Segmentation

Segmentation only uses sparse annotations: Unified weakly and semi-supervised learning in medical images

Contrastive Semi-Supervised Learning for Domain Adaptive Segmentation Across Similar Anatomical Structures