Polymorphism due to selection depending on the composition of a population

J. Haldane,S. Jayakar

DOI: https://doi.org/10.1007/BF02986301

1963-12-01

Abstract:

What problem does this paper attempt to address?

Active Learning in Brain Tumor Segmentation with Uncertainty Sampling and Annotation Redundancy Restriction

Daniel D Kim,Rajat S Chandra,Li Yang,Jing Wu,Xue Feng,Michael Atalay,Chetan Bettegowda,Craig Jones,Haris Sair,Wei-Hua Liao,Chengzhang Zhu,Beiji Zou,Anahita Fathi Kazerooni,Ali Nabavizadeh,Zhicheng Jiao,Jian Peng,Harrison X Bai

DOI: https://doi.org/10.1007/s10278-024-01037-6

Abstract:Deep learning models have demonstrated great potential in medical imaging but are limited by the expensive, large volume of annotations required. To address this, we compared different active learning strategies by training models on subsets of the most informative images using real-world clinical datasets for brain tumor segmentation and proposing a framework that minimizes the data needed while maintaining performance. Then, 638 multi-institutional brain tumor magnetic resonance imaging scans were used to train three-dimensional U-net models and compare active learning strategies. Uncertainty estimation techniques including Bayesian estimation with dropout, bootstrapping, and margins sampling were compared to random query. Strategies to avoid annotating similar images were also considered. We determined the minimum data necessary to achieve performance equivalent to the model trained on the full dataset (α = 0.05). Bayesian approximation with dropout at training and testing showed results equivalent to that of the full data model (target) with around 30% of the training data needed by random query to achieve target performance (p = 0.018). Annotation redundancy restriction techniques can reduce the training data needed by random query to achieve target performance by 20%. We investigated various active learning strategies to minimize the annotation burden for three-dimensional brain tumor segmentation. Dropout uncertainty estimation achieved target performance with the least annotated data.
PCDAL: A Perturbation Consistency-Driven Active Learning Approach for Medical Image Segmentation and Classification

Tao Wang,Xinlin Zhang,Yuanbo Zhou,Junlin Lan,Tao Tan,Min Du,Qinquan Gao,Tong Tong

2023-06-29

Abstract:In recent years, deep learning has become a breakthrough technique in assisting medical image diagnosis. Supervised learning using convolutional neural networks (CNN) provides state-of-the-art performance and has served as a benchmark for various medical image segmentation and classification. However, supervised learning deeply relies on large-scale annotated data, which is expensive, time-consuming, and even impractical to acquire in medical imaging applications. Active Learning (AL) methods have been widely applied in natural image classification tasks to reduce annotation costs by selecting more valuable examples from the unlabeled data pool. However, their application in medical image segmentation tasks is limited, and there is currently no effective and universal AL-based method specifically designed for 3D medical image segmentation. To address this limitation, we propose an AL-based method that can be simultaneously applied to 2D medical image classification, segmentation, and 3D medical image segmentation tasks. We extensively validated our proposed active learning method on three publicly available and challenging medical image datasets, Kvasir Dataset, COVID-19 Infection Segmentation Dataset, and BraTS2019 Dataset. The experimental results demonstrate that our PCDAL can achieve significantly improved performance with fewer annotations in 2D classification and segmentation and 3D segmentation tasks. The codes of this study are available at <a class="link-external link-https" href="https://github.com/ortonwang/PCDAL" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
Breaking the Barrier: Selective Uncertainty-based Active Learning for Medical Image Segmentation

Siteng Ma,Haochang Wu,Aonghus Lawlor,Ruihai Dong

2024-01-30

Abstract:Active learning (AL) has found wide applications in medical image segmentation, aiming to alleviate the annotation workload and enhance performance. Conventional uncertainty-based AL methods, such as entropy and Bayesian, often rely on an aggregate of all pixel-level metrics. However, in imbalanced settings, these methods tend to neglect the significance of target regions, eg., lesions, and tumors. Moreover, uncertainty-based selection introduces redundancy. These factors lead to unsatisfactory performance, and in many cases, even underperform random sampling. To solve this problem, we introduce a novel approach called the Selective Uncertainty-based AL, avoiding the conventional practice of summing up the metrics of all pixels. Through a filtering process, our strategy prioritizes pixels within target areas and those near decision boundaries. This resolves the aforementioned disregard for target areas and redundancy. Our method showed substantial improvements across five different uncertainty-based methods and two distinct datasets, utilizing fewer labeled data to reach the supervised baseline and consistently achieving the highest overall performance. Our code is available at

Computer Vision and Pattern Recognition,Artificial Intelligence
Multi-scale adversarial learning with difficult region supervision learning models for primary tumor segmentation

Shenhai Zheng,Qiuyu Sun,Xin Ye,Weisheng Li,Lei Yu,Chaohui Yang

DOI: https://doi.org/10.1088/1361-6560/ad3321

IF: 3.5

2024-03-13

Physics in Medicine and Biology

Abstract:Objective. Recently, deep learning techniques have found extensive application in accurate and automated segmentation of tumor regions. However, owing to the variety of tumor shapes, complex types, and unpredictability of spatial distribution, tumor segmentation still faces major challenges. Taking cues from the deep supervision and adversarial learning, we have devised a cascade-based methodology incorporating multi-scale adversarial learning and difficult-region supervision learning in this study to tackle these challenges. Approach. Overall, the method adheres to a coarse-to-fine strategy, first roughly locating the target region, and then refining the target object with multi-stage cascaded binary segmentation which converts complex multi-class segmentation problems into multiple simpler binary segmentation problems. In addition, a Multi-Scale Adversarial Learning Difficult Supervised UNet (MSALDS-UNet) is proposed as our model for fine-segmentation, which applies multiple discriminators along the decoding path of the segmentation network to implement multi-scale adversarial learning, thereby enhancing the accuracy of network segmentation. Meanwhile, in MSALDS-UNet, we introduce a difficult region supervision loss to effectively utilize structural information for segmenting difficult-to-distinguish areas, such as blurry boundary areas. Main results. A thorough validation of three independent public databases (KiTS21, MSD's Brain and Pancreas datasets) shows that our model achieves satisfactory results for tumor segmentation in terms of key evaluation metrics including extcolor{red}{DSC, JC, and HD95}. Significance. This paper introduces a cascade approach that combines multi-scale adversarial learning and difficult supervision to achieve precise tumor segmentation. It confirms that the combination can improve the segmentation performance, especially for small objects. (Our code will be publicly available after acceptance on https://zhengshenhai.github.io/)

engineering, biomedical,radiology, nuclear medicine & medical imaging
ALA-Net: Adaptive Lesion-Aware Attention Network for 3D Colorectal Tumor Segmentation

Yankai Jiang,Shufeng Xu,Hongjie Fan,Jiahong Qian,Weizhi Luo,Shihui Zhen,Jihong Sun,Yubo Tao,Hai Lin

DOI: https://doi.org/10.1109/TMI.2021.3093982

IF: 10.6

2021-01-01

IEEE Transactions on Medical Imaging

Abstract:Accurate and reliable segmentation of colorectal tumors and surrounding colorectal tissues on 3D magnetic resonance images has critical importance in preoperative prediction, staging, and radiotherapy. Previous works simply combine multilevel features without aggregating representative semantic information and without compensating for the loss of spatial information caused by down-sampling. Theref...
Predictive Accuracy-Based Active Learning for Medical Image Segmentation

Jun Shi,Shulan Ruan,Ziqi Zhu,Minfan Zhao,Hong An,Xudong Xue,Bing Yan

2024-06-29

Abstract:Active learning is considered a viable solution to alleviate the contradiction between the high dependency of deep learning-based segmentation methods on annotated data and the expensive pixel-level annotation cost of medical images. However, most existing methods suffer from unreliable uncertainty assessment and the struggle to balance diversity and informativeness, leading to poor performance in segmentation tasks. In response, we propose an efficient Predictive Accuracy-based Active Learning (PAAL) method for medical image segmentation, first introducing predictive accuracy to define uncertainty. Specifically, PAAL mainly consists of an Accuracy Predictor (AP) and a Weighted Polling Strategy (WPS). The former is an attached learnable module that can accurately predict the segmentation accuracy of unlabeled samples relative to the target model with the predicted posterior probability. The latter provides an efficient hybrid querying scheme by combining predicted accuracy and feature representation, aiming to ensure the uncertainty and diversity of the acquired samples. Extensive experiment results on multiple datasets demonstrate the superiority of PAAL. PAAL achieves comparable accuracy to fully annotated data while reducing annotation costs by approximately 50% to 80%, showcasing significant potential in clinical applications. The code is available at <a class="link-external link-https" href="https://github.com/shijun18/PAAL-MedSeg" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Adaptive Local-Fitting-based Active Contour Model for Medical Image Segmentation

Dongdong Ma,Qingmin Liao,Ziqin Chen,Ran Liao,Hui Ma

DOI: https://doi.org/10.1016/j.image.2019.05.006

2019-01-01

Abstract:Due to the complex environments, characteristics of samples and limits of acquisition instruments, medical images are often acquired with intensity inhomogeneity and noise. These two consequences have brought challenges in medical image segmentation, especially when the background has similar intensity with the region of interest (ROI). Although lots of active-contour-model-based methods have appeared to extract ROI accurately, finer segmentation especially in tiny areas is still a difficult problem. In this paper, an adaptive local-fitting-based active contour model is proposed to separate the ROI accurately and robustly, which takes both adaptive local fitting energy and regularization energy to drive the initial contour to the object boundary. Unlike the traditional methods which assume the intensities in local region are constant, the proposed method takes an adaptive technique to fit the original image, which contributes to a more optimal solution. Experiments are conducted on lots of synthetic and real medical images. Results show that the proposed method not only obtains more accurate segmentation results than several well-known algorithms, while is robust to intensity inhomogeneity and noises. The source code is available at: https://github.com/madd2014/ALF.
Diminishing Uncertainty Within the Training Pool: Active Learning for Medical Image Segmentation

Vishwesh Nath,Dong Yang,Bennett A. Landman,Daguang Xu,Holger R. Roth

DOI: https://doi.org/10.1109/tmi.2020.3048055

IF: 10.6

2021-10-01

IEEE Transactions on Medical Imaging

Abstract:Active learning is a unique abstraction of machine learning techniques where the model/algorithm could guide users for annotation of a set of data points that would be beneficial to the model, unlike passive machine learning. The primary advantage being that active learning frameworks select data points that can accelerate the learning process of a model and can reduce the amount of data needed to achieve full accuracy as compared to a model trained on a randomly acquired data set. Multiple frameworks for active learning combined with deep learning have been proposed, and the majority of them are dedicated to classification tasks. Herein, we explore active learning for the task of segmentation of medical imaging data sets. We investigate our proposed framework using two datasets: 1.) MRI scans of the hippocampus, 2.) CT scans of pancreas and tumors. This work presents a query-by-committee approach for active learning where a joint optimizer is used for the committee. At the same time, we propose three new strategies for active learning: 1.) increasing frequency of uncertain data to bias the training data set; 2.) Using mutual information among the input images as a regularizer for acquisition to ensure diversity in the training dataset; 3.) adaptation of Dice log-likelihood for Stein variational gradient descent (SVGD). The results indicate an improvement in terms of data reduction by achieving full accuracy while only using 22.69% and 48.85% of the available data for each dataset, respectively.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalities

Hong Liu,Dong Wei,Donghuan Lu,Jinghan Sun,Liansheng Wang,Yefeng Zheng

DOI: https://doi.org/10.1609/aaai.v37i2.25253

2023-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Multimodal magnetic resonance imaging (MRI) provides complementary information for sub-region analysis of brain tumors. Plenty of methods have been proposed for automatic brain tumor segmentation using four common MRI modalities and achieved remarkable performance. In practice, however, it is common to have one or more modalities missing due to image corruption, artifacts, acquisition protocols, allergy to contrast agents, or simply cost. In this work, we propose a novel two-stage framework for brain tumor segmentation with missing modalities. In the first stage, a multimodal masked autoencoder (M3AE) is proposed, where both random modalities (i.e., modality dropout) and random patches of the remaining modalities are masked for a reconstruction task, for self-supervised learning of robust multimodal representations against missing modalities. To this end, we name our framework M3AE. Meanwhile, we employ model inversion to optimize a representative full-modal image at marginal extra cost, which will be used to substitute for the missing modalities and boost performance during inference. Then in the second stage, a memory-efficient self distillation is proposed to distill knowledge between heterogenous missing-modal situations while fine-tuning the model for supervised segmentation. Our M3AE belongs to the 'catch-all' genre where a single model can be applied to all possible subsets of modalities, thus is economic for both training and deployment. Extensive experiments on BraTS 2018 and 2020 datasets demonstrate its superior performance to existing state-of-the-art methods with missing modalities, as well as the efficacy of its components. Our code is available at: https://github.com/ccarliu/m3ae.
MTANS: Multi-Scale Mean Teacher Combined Adversarial Network with Shape-Aware Embedding for Semi-Supervised Brain Lesion Segmentation

Gaoxiang Chen,Jintao Ru,Yilin Zhou,Islem Rekik,Zhifang Pan,Xiaoming Liu,Yezhi Lin,Beichen Lu,Jialin Shi

DOI: https://doi.org/10.1016/j.neuroimage.2021.118568

IF: 5.7

2021-12-01

NeuroImage

Abstract:The annotation of brain lesion images is a key step in clinical diagnosis and treatment of a wide spectrum of brain diseases. In recent years, segmentation methods based on deep learning have gained unprecedented popularity, leveraging a large amount of data with high-quality voxel-level annotations. However, due to the limited time clinicians can provide for the cumbersome task of manual image segmentation, semi-supervised medical image segmentation methods present an alternative solution as they require only a few labeled samples for training. In this paper, we propose a novel semi-supervised segmentation framework that combines improved mean teacher and adversarial network. Specifically, our framework consists of (i) a student model and a teacher model for segmenting the target and generating the signed distance maps of object surfaces, and (ii) a discriminator network for extracting hierarchical features and distinguishing the signed distance maps of labeled and unlabeled data. Besides, based on two different adversarial learning processes, a multi-scale feature consistency loss derived from the student and teacher models is proposed, and a shape-aware embedding scheme is integrated into our framework. We evaluated the proposed method on the public brain lesion datasets from ISBI 2015, ISLES 2015, and BRATS 2018 for the multiple sclerosis lesion, ischemic stroke lesion, and brain tumor segmentation respectively. Experiments demonstrate that our method can effectively leverage unlabeled data while outperforming the supervised baseline and other state-of-the-art semi-supervised methods trained with the same labeled data. The proposed framework is suitable for joint training of limited labeled data and additional unlabeled data, which is expected to reduce the effort of obtaining annotated images.

radiology, nuclear medicine & medical imaging,neurosciences,neuroimaging
Active learning for medical image segmentation with stochastic batches

Mélanie Gaillochet,Christian Desrosiers,Hervé Lombaert

DOI: https://doi.org/10.48550/arXiv.2301.07670

2023-01-18

Computer Vision and Pattern Recognition

Abstract:The performance of learning-based algorithms improves with the amount of labelled data used for training. Yet, manually annotating data can be tedious and expensive, especially in medical image segmentation. To reduce manual labelling, active learning (AL) targets the most informative samples from the unlabelled set to annotate and add to the labelled training set. On one hand, most active learning works have focused on the classification or limited segmentation of natural images, despite active learning being highly desirable in the difficult task of medical image segmentation. On the other hand, uncertainty-based AL approaches notoriously offer sub-optimal batch-query strategies, while diversity-based methods tend to be computationally expensive. Over and above methodological hurdles, random sampling has proven an extremely difficult baseline to outperform when varying learning and sampling conditions. This work aims to take advantage of the diversity and speed offered by random sampling to improve the selection of uncertainty-based AL methods for segmenting medical images. More specifically, we propose to compute uncertainty at the level of batches instead of samples through an original use of stochastic batches during sampling in AL. Exhaustive experiments on medical image segmentation, with an illustration on MRI prostate imaging, show that the benefits of stochastic batches during sample selection are robust to a variety of changes in the training and sampling procedures.
M-VAAL: Multimodal Variational Adversarial Active Learning for Downstream Medical Image Analysis Tasks

Bidur Khanal,Binod Bhattarai,Bishesh Khanal,Danail Stoyanov,Cristian A. Linte

2023-06-22

Abstract:Acquiring properly annotated data is expensive in the medical field as it requires experts, time-consuming protocols, and rigorous validation. Active learning attempts to minimize the need for large annotated samples by actively sampling the most informative examples for annotation. These examples contribute significantly to improving the performance of supervised machine learning models, and thus, active learning can play an essential role in selecting the most appropriate information in deep learning-based diagnosis, clinical assessments, and treatment planning. Although some existing works have proposed methods for sampling the best examples for annotation in medical image analysis, they are not task-agnostic and do not use multimodal auxiliary information in the sampler, which has the potential to increase robustness. Therefore, in this work, we propose a Multimodal Variational Adversarial Active Learning (M-VAAL) method that uses auxiliary information from additional modalities to enhance the active sampling. We applied our method to two datasets: i) brain tumor segmentation and multi-label classification using the BraTS2018 dataset, and ii) chest X-ray image classification using the COVID-QU-Ex dataset. Our results show a promising direction toward data-efficient learning under limited annotations.

Image and Video Processing,Computer Vision and Pattern Recognition
Impact of Adversarial Examples on Deep Learning Models for Biomedical Image Segmentation

Utku Ozbulak,Arnout Van Messem,Wesley De Neve

DOI: https://doi.org/10.48550/arXiv.1907.13124

2019-07-30

Image and Video Processing

Abstract:Deep learning models, which are increasingly being used in the field of medical image analysis, come with a major security risk, namely, their vulnerability to adversarial examples. Adversarial examples are carefully crafted samples that force machine learning models to make mistakes during testing time. These malicious samples have been shown to be highly effective in misguiding classification tasks. However, research on the influence of adversarial examples on segmentation is significantly lacking. Given that a large portion of medical imaging problems are effectively segmentation problems, we analyze the impact of adversarial examples on deep learning-based image segmentation models. Specifically, we expose the vulnerability of these models to adversarial examples by proposing the Adaptive Segmentation Mask Attack (ASMA). This novel algorithm makes it possible to craft targeted adversarial examples that come with (1) high intersection-over-union rates between the target adversarial mask and the prediction and (2) with perturbation that is, for the most part, invisible to the bare eye. We lay out experimental and visual evidence by showing results obtained for the ISIC skin lesion segmentation challenge and the problem of glaucoma optic disc segmentation. An implementation of this algorithm and additional examples can be found at https://github.com/utkuozbulak/adaptive-segmentation-mask-attack.
An active learning approach to train a deep learning algorithm for tumor segmentation from brain MR images

Andrew S. Boehringer,Amirhossein Sanaat,Hossein Arabi,Habib Zaidi

DOI: https://doi.org/10.1186/s13244-023-01487-6

IF: 5.0363

2023-08-26

Insights into Imaging

Abstract:This study focuses on assessing the performance of active learning techniques to train a brain MRI glioma segmentation model.

radiology, nuclear medicine & medical imaging
Reciprocal Adversarial Learning for Brain Tumor Segmentation: A Solution to BraTS Challenge 2021 Segmentation Task

Himashi Peiris,Zhaolin Chen,Gary Egan,Mehrtash Harandi

DOI: https://doi.org/10.48550/arXiv.2201.03777

2022-01-11

Abstract:This paper proposes an adversarial learning based training approach for brain tumor segmentation task. In this concept, the 3D segmentation network learns from dual reciprocal adversarial learning approaches. To enhance the generalization across the segmentation predictions and to make the segmentation network robust, we adhere to the Virtual Adversarial Training approach by generating more adversarial examples via adding some noise on original patient data. By incorporating a critic that acts as a quantitative subjective referee, the segmentation network learns from the uncertainty information associated with segmentation results. We trained and evaluated network architecture on the RSNA-ASNR-MICCAI BraTS 2021 dataset. Our performance on the online validation dataset is as follows: Dice Similarity Score of 81.38%, 90.77% and 85.39%; Hausdorff Distance (95\%) of 21.83 mm, 5.37 mm, 8.56 mm for the enhancing tumor, whole tumor and tumor core, respectively. Similarly, our approach achieved a Dice Similarity Score of 84.55%, 90.46% and 85.30%, as well as Hausdorff Distance (95\%) of 13.48 mm, 6.32 mm and 16.98 mm on the final test dataset. Overall, our proposed approach yielded better performance in segmentation accuracy for each tumor sub-region. Our code implementation is publicly available at <a class="link-external link-https" href="https://github.com/himashi92/vizviva_brats_2021" rel="external noopener nofollow">this https URL</a>

Image and Video Processing,Computer Vision and Pattern Recognition
Active Learning for Segmentation by Optimizing Content Information for Maximal Entropy

Firat Ozdemir,Zixuan Peng,Christine Tanner,Philipp Fuernstahl,Orcun Goksel

DOI: https://doi.org/10.1007/978-3-030-00889-5_21

2018-07-18

Abstract:Segmentation is essential for medical image analysis tasks such as intervention planning, therapy guidance, diagnosis, treatment decisions. Deep learning is becoming increasingly prominent for segmentation, where the lack of annotations, however, often becomes the main limitation. Due to privacy concerns and ethical considerations, most medical datasets are created, curated, and allow access only locally. Furthermore, current deep learning methods are often suboptimal in translating anatomical knowledge between different medical imaging modalities. Active learning can be used to select an informed set of image samples to request for manual annotation, in order to best utilize the limited annotation time of clinical experts for optimal outcomes, which we focus on in this work. Our contributions herein are two fold: (1) we enforce domain-representativeness of selected samples using a proposed penalization scheme to maximize information at the network abstraction layer, and (2) we propose a Borda-count based sample querying scheme for selecting samples for segmentation. Comparative experiments with baseline approaches show that the samples queried with our proposed method, where both above contributions are combined, result in significantly improved segmentation performance for this active learning task.

Computer Vision and Pattern Recognition,Machine Learning
Active learning using adaptable task-based prioritisation

Shaheer U. Saeed,João Ramalhinho,Mark Pinnock,Ziyi Shen,Yunguan Fu,Nina Montaña-Brown,Ester Bonmati,Dean C. Barratt,Stephen P. Pereira,Brian Davidson,Matthew J. Clarkson,Yipeng Hu

DOI: https://doi.org/10.1016/j.media.2024.103181

IF: 10.9

2024-04-17

Medical Image Analysis

Abstract:Supervised machine learning-based medical image computing applications necessitate expert label curation, while unlabelled image data might be relatively abundant. Active learning methods aim to prioritise a subset of available image data for expert annotation, for label-efficient model training. We develop a controller neural network that measures priority of images in a sequence of batches, as in batch-mode active learning, for multi-class segmentation tasks. The controller is optimised by rewarding positive task-specific performance gain, within a Markov decision process (MDP) environment that also optimises the task predictor. In this work, the task predictor is a segmentation network. A meta-reinforcement learning algorithm is proposed with multiple MDPs, such that the pre-trained controller can be adapted to a new MDP that contains data from different institutes and/or requires segmentation of different organs or structures within the abdomen. We present experimental results using multiple CT datasets from more than one thousand patients, with segmentation tasks of nine different abdominal organs, to demonstrate the efficacy of the learnt prioritisation controller function and its cross-institute and cross-organ adaptability. We show that the proposed adaptable prioritisation metric yields converging segmentation accuracy for a new kidney segmentation task, unseen in training, using between approximately 40% to 60% of labels otherwise required with other heuristic or random prioritisation metrics. For clinical datasets of limited size, the proposed adaptable prioritisation offers a performance improvement of 22.6% and 10.2% in Dice score, for tasks of kidney and liver vessel segmentation, respectively, compared to random prioritisation and alternative active sampling strategies.

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
Suggestive Annotation of Brain Tumour Images with Gradient-guided Sampling

Chengliang Dai,Shuo Wang,Yuanhan Mo,Kaichen Zhou,Elsa Angelini,Yike Guo,Wenjia Bai

DOI: https://doi.org/10.48550/arXiv.2006.14984

2020-06-26

Computer Vision and Pattern Recognition

Abstract:Machine learning has been widely adopted for medical image analysis in recent years given its promising performance in image segmentation and classification tasks. As a data-driven science, the success of machine learning, in particular supervised learning, largely depends on the availability of manually annotated datasets. For medical imaging applications, such annotated datasets are not easy to acquire. It takes a substantial amount of time and resource to curate an annotated medical image set. In this paper, we propose an efficient annotation framework for brain tumour images that is able to suggest informative sample images for human experts to annotate. Our experiments show that training a segmentation model with only 19% suggestively annotated patient scans from BraTS 2019 dataset can achieve a comparable performance to training a model on the full dataset for whole tumour segmentation task. It demonstrates a promising way to save manual annotation cost and improve data efficiency in medical imaging applications.
Quality-driven deep active learning method for 3D brain MRI segmentation

Zhenxi Zhang,Jie Li,Chunna Tian,Zhusi Zhong,Zhicheng Jiao,Xinbo Gao

DOI: https://doi.org/10.1016/j.neucom.2021.03.050

IF: 6

2021-07-01

Neurocomputing

Abstract:Automatic segmentation of the brain Magnetic Resonance Imaging (MRI) plays a crucial role in many brain MRI processing algorithms, which is effective for the prevention, detection, monitoring, and treatment planning of brain disease. Currently, deep learning algorithms have shown outstanding performance in brain segmentation. Most algorithms train models with fully annotated brain MRI datasets. However, full annotation of 3D brain MRI is laborious and time-consuming. Using sparsely annotated datasets to train models may be one appropriate solution to reduce annotation cost. However, the approach of 3D dense segmentation with sparse annotation has not been fully studied. In this paper, we develop a segmentation framework combined with the quality-driven active learning (QDAL) module for suggestive annotation. In the proposed Active Learning module, attention mechanism and deep supervision mode are used to improve the segmentation accuracy and feedback segmentation quality information. Meanwhile, we observe a high correlation coefficient between the proposed two surrogate metrics and the real segmentation accuracy of per slice in one scan. We validate our framework on two public brain MRI datasets for brain region extraction and brain tissue segmentation. The comparative experiments demonstrate that the QDAL method outperforms the other four popular sampling strategies. The segmentation network with the guidance of the QDAL method only needs 15<math>%</math> to 20<math>%</math> annotated slices in brain extraction task, and 30<math>%</math> to 40<math>%</math> annotated slices in tissue segmentation task to achieve competitive results compared with training with full supervision.

computer science, artificial intelligence
Rethinking Deep Active Learning for Medical Image Segmentation: A Diffusion and Angle-Based Framework

Linhao Qu,Qiuye Jin,Kexue Fu,Manning Wang,Zhijian Song

DOI: https://doi.org/10.1016/j.bspc.2024.106493

IF: 5.1

2024-01-01

Biomedical Signal Processing and Control

Abstract:Semantic segmentation based on deep learning typically necessitates a substantial number of finely annotated samples for effective model training. However, acquiring such annotations can be prohibitively expensive and challenging, particularly within the domain of medical image segmentation. Active learning (AL) offers a solution by enabling the selection of the most informative samples for labeling, thereby enhancing annotation efficiency and reducing associated costs. Nevertheless, most existing AL methods operate within an iterative paradigm, which is time-consuming and resource-intensive, thus limiting their practicality in medical applications. Recently, a more viable alternative called the one-shot AL paradigm has emerged, which involves a single interaction with experts and has demonstrated comparable performance to iterative algorithms in image segmentation tasks. In this paper, we propose DifABAL: a novel angle-based one-shot AL framework utilizing diffusion autoencoders for medical image segmentation. Specifically, we leverage diffusion model-based autoencoders to extract features from unlabeled samples and introduce a novel parameter-robust angle-based query strategy for selecting representative samples in the feature space. Extensive experiments conducted on three large publicly available datasets comprising pathology images, chest X-ray images, and dermatology images demonstrate the remarkable performance of our framework. The source code is available at https://github.com/miccaiif/DifABAL.

Polymorphism due to selection depending on the composition of a population

Active Learning in Brain Tumor Segmentation with Uncertainty Sampling and Annotation Redundancy Restriction

PCDAL: A Perturbation Consistency-Driven Active Learning Approach for Medical Image Segmentation and Classification

Breaking the Barrier: Selective Uncertainty-based Active Learning for Medical Image Segmentation

Multi-scale adversarial learning with difficult region supervision learning models for primary tumor segmentation

ALA-Net: Adaptive Lesion-Aware Attention Network for 3D Colorectal Tumor Segmentation

Predictive Accuracy-Based Active Learning for Medical Image Segmentation

Adaptive Local-Fitting-based Active Contour Model for Medical Image Segmentation

Diminishing Uncertainty Within the Training Pool: Active Learning for Medical Image Segmentation

M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalities

MTANS: Multi-Scale Mean Teacher Combined Adversarial Network with Shape-Aware Embedding for Semi-Supervised Brain Lesion Segmentation

Active learning for medical image segmentation with stochastic batches

M-VAAL: Multimodal Variational Adversarial Active Learning for Downstream Medical Image Analysis Tasks

Impact of Adversarial Examples on Deep Learning Models for Biomedical Image Segmentation

An active learning approach to train a deep learning algorithm for tumor segmentation from brain MR images

Reciprocal Adversarial Learning for Brain Tumor Segmentation: A Solution to BraTS Challenge 2021 Segmentation Task

Active Learning for Segmentation by Optimizing Content Information for Maximal Entropy

Active learning using adaptable task-based prioritisation

Suggestive Annotation of Brain Tumour Images with Gradient-guided Sampling

Quality-driven deep active learning method for 3D brain MRI segmentation

Rethinking Deep Active Learning for Medical Image Segmentation: A Diffusion and Angle-Based Framework