Abstract:Partially-supervised multi-organ medical image segmentation aims to develop a unified semantic segmentation model by utilizing multiple partially-labeled datasets, with each dataset providing labels for a single class of organs. However, the limited availability of labeled foreground organs and the absence of supervision to distinguish unlabeled foreground organs from the background pose a significant challenge, which leads to a distribution mismatch between labeled and unlabeled pixels. Although existing pseudo-labeling methods can be employed to learn from both labeled and unlabeled pixels, they are prone to performance degradation in this task, as they rely on the assumption that labeled and unlabeled pixels have the same distribution. In this paper, to address the problem of distribution mismatch, we propose a labeled-to-unlabeled distribution alignment (LTUDA) framework that aligns feature distributions and enhances discriminative capability. Specifically, we introduce a cross-set data augmentation strategy, which performs region-level mixing between labeled and unlabeled organs to reduce distribution discrepancy and enrich the training set. Besides, we propose a prototype-based distribution alignment method that implicitly reduces intra-class variation and increases the separation between the unlabeled foreground and background. This can be achieved by encouraging consistency between the outputs of two prototype classifiers and a linear classifier. Extensive experimental results on the AbdomenCT-1K dataset and a union of four benchmark datasets (including LiTS, MSD-Spleen, KiTS, and NIH82) demonstrate that our method outperforms the state-of-the-art partially-supervised methods by a considerable margin, and even surpasses the fully-supervised methods. The source code is publicly available at <a class="link-external link-https" href="https://github.com/xjiangmed/LTUDA" rel="external noopener nofollow">this https URL</a>.

Partially Supervised Multi-organ Segmentation Via Affinity-Aware Consistency Learning and Cross Site Feature Alignment

Multi-site Organ Segmentation with Federated Partial Supervision and Site Adaptation

MOSMOS: Multi-organ segmentation facilitated by medical report supervision

Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

Multi-organ segmentation: a progressive exploration of learning paradigms under scarce annotation

Federated 3D multi-organ segmentation with partially labeled and unlabeled data

Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentation

Robust Semi-supervised Multimodal Medical Image Segmentation via Cross Modality Collaboration

Learning Multi-Organ Segmentation Via Partial- and Mutual-Prior from Single-Organ Datasets

Multi-organ Segmentation over Partially Labeled Datasets with Multi-scale Feature Abstraction

Semi-supervised Abdominal Multi-organ Segmentation Via Contour Aware Dual-Task Consistency

Multi-label Abdominal Image Segmentation with Partially Labeled Data: A Prototypical Consistent Learning Perspective.

Federated Multi-organ Segmentation with Inconsistent Labels

Exploring Inherent Consistency for Semi-supervised Anatomical Structure Segmentation in Medical Imaging

Labeled-to-Unlabeled Distribution Alignment for Partially-Supervised Multi-Organ Medical Image Segmentation

Hybrid Intelligent-Annotation Organ Segmentation on Medical Datasets

Deconfounded multi-organ weakly-supervised semantic segmentation via causal intervention

UniMOS: A Universal Framework For Multi-Organ Segmentation Over Label-Constrained Datasets

Multi-organ Segmentation via Co-training Weight-averaged Models from Few-organ Datasets

MASS: Modality-collaborative semi-supervised segmentation by exploiting cross-modal consistency from unpaired CT and MRI images