Abstract:High performance of deep learning models on medical image segmentation greatly relies on large amount of pixel-wise annotated data, yet annotations are costly to collect. How to obtain high accuracy segmentation labels of medical images with limited cost (e.g. time) becomes an urgent problem. Active learning can reduce the annotation cost of image segmentation, but it faces three challenges: the cold start problem, an effective sample selection strategy for segmentation task and the burden of manual annotation. In this work, we propose a H ybrid A ctive L earning framework using I nteractive A nnotation ( HAL-IA ) for medical image segmentation, which reduces the annotation cost both in decreasing the amount of the annotated images and simplifying the annotation process. Specifically, we propose a novel hybrid sample selection strategy to select the most valuable samples for segmentation model performance improvement. This strategy combines pixel entropy, regional consistency and image diversity to ensure that the selected samples have high uncertainty and diversity. In addition, we propose a warm-start initialization strategy to build the initial annotated dataset to avoid the cold-start problem. To simplify the manual annotation process, we propose an interactive annotation module with suggested superpixels to obtain pixel-wise label with several clicks. We validate our proposed framework with extensive segmentation experiments on four medical image datasets. Experimental results showed that the proposed framework achieves high accuracy pixel-wise annotations and models with less labeled data and fewer interactions, outperforming other state-of-the-art methods. Our method can help physicians efficiently obtain accurate medical image segmentation results for clinical analysis and diagnosis.

Cost-Effective Active Learning with Informativeness and Representativeness for Semantic Segmentation

Cost-Effective Active Learning for Deep Image Classification

ESA: Annotation-Efficient Active Learning for Semantic Segmentation

Supervoxel-based and Cost-Effective Active Learning for Point Cloud Semantic Segmentation.

Active Learning for Point Cloud Semantic Segmentation Via Spatial-Structural Diversity Reasoning

Edge-guided and Class-balanced Active Learning for Semantic Segmentation of Aerial Images

Best Practices in Active Learning for Semantic Segmentation

You Never Get a Second Chance To Make a Good First Impression: Seeding Active Learning for 3D Semantic Segmentation

CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation

Bayesian Active Learning for Semantic Segmentation

Annotator: A Generic Active Learning Baseline for LiDAR Semantic Segmentation

DEAL: Difficulty-aware Active Learning for Semantic Segmentation

Class Balanced Dynamic Acquisition for Domain Adaptive Semantic Segmentation using Active Learning

Attention, Suggestion and Annotation: A Deep Active Learning Framework for Biomedical Image Segmentation

HAL-IA: A Hybrid Active Learning framework using Interactive Annotation for medical image segmentation

EasySeg: An Error-Aware Domain Adaptation Framework for Remote Sensing Imagery Semantic Segmentation via Interactive Learning and Active Learning

Annotation-Efficient Polyp Segmentation via Active Learning

MetaBox+: A new Region Based Active Learning Method for Semantic Segmentation using Priority Maps

A Multi-Granularity Semisupervised Active Learning for Point Cloud Semantic Segmentation

How to Efficiently Annotate Images for Best-Performing Deep Learning Based Segmentation Models: An Empirical Study with Weak and Noisy Annotations and Segment Anything Model

Coarse-to-Fine Annotation Enrichment for Semantic Segmentation Learning