Abstract:Partially-supervised multi-organ medical image segmentation aims to develop a unified semantic segmentation model by utilizing multiple partially-labeled datasets, with each dataset providing labels for a single class of organs. However, the limited availability of labeled foreground organs and the absence of supervision to distinguish unlabeled foreground organs from the background pose a significant challenge, which leads to a distribution mismatch between labeled and unlabeled pixels. Although existing pseudo-labeling methods can be employed to learn from both labeled and unlabeled pixels, they are prone to performance degradation in this task, as they rely on the assumption that labeled and unlabeled pixels have the same distribution. In this paper, to address the problem of distribution mismatch, we propose a labeled-to-unlabeled distribution alignment (LTUDA) framework that aligns feature distributions and enhances discriminative capability. Specifically, we introduce a cross-set data augmentation strategy, which performs region-level mixing between labeled and unlabeled organs to reduce distribution discrepancy and enrich the training set. Besides, we propose a prototype-based distribution alignment method that implicitly reduces intra-class variation and increases the separation between the unlabeled foreground and background. This can be achieved by encouraging consistency between the outputs of two prototype classifiers and a linear classifier. Extensive experimental results on the AbdomenCT-1K dataset and a union of four benchmark datasets (including LiTS, MSD-Spleen, KiTS, and NIH82) demonstrate that our method outperforms the state-of-the-art partially-supervised methods by a considerable margin, and even surpasses the fully-supervised methods. The source code is publicly available at <a class="link-external link-https" href="https://github.com/xjiangmed/LTUDA" rel="external noopener nofollow">this https URL</a>.

Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

Multi-organ Segmentation over Partially Labeled Datasets with Multi-scale Feature Abstraction

PAMSNet: A medical image segmentation network based on spatial pyramid and attention mechanism

GuidedNet: Semi-Supervised Multi-Organ Segmentation via Labeled Data Guide Unlabeled Data

Multi-shot Prototype Contrastive Learning and Semantic Reasoning for Medical Image Segmentation

Prior Attention Network for Multi-Lesion Segmentation in Medical Images

Labeled-to-Unlabeled Distribution Alignment for Partially-Supervised Multi-Organ Medical Image Segmentation

SUnet: A Multi-Organ Segmentation Network Based on Multiple Attention

Discriminative Features Pyramid Network for Medical Image Segmentation

DTSC-Net: Semi-supervised 3D Biomedical Image Segmentation through Dual-Teacher Simplified Consistency.

PLN: Parasitic-Like Network for Barely Supervised Medical Image Segmentation

UniMOS: A Universal Framework For Multi-Organ Segmentation Over Label-Constrained Datasets

M$^{2}$SNet: Multi-scale in Multi-scale Subtraction Network for Medical Image Segmentation

SDPN: A Slight Dual-Path Network With Local-Global Attention Guided For Medical Image Segmentation

Ssm-Net: Semi-Supervised Multi-Task Network for Joint Lesion Segmentation and Classification from Pancreatic Eus Images

TANet: Triple Attention Network for medical image segmentation

COSST: Multi-organ Segmentation with Partially Labeled Datasets Using Comprehensive Supervisions and Self-training

DS-MSFF-Net: Dual-path Self-Attention Multi-Scale Feature Fusion Network for CT Image Segmentation

Segmentation of Intravascular Ultrasound by Deep Learning on Partially Labelled Dataset

MTL-ABS3Net: Atlas-Based Semi-Supervised Organ Segmentation Network with Multi-Task Learning for Medical Images

3D Medical Image Segmentation with Sparse Annotation via Cross-Teaching between 3D and 2D Networks