Abstract:Partially-supervised multi-organ medical image segmentation aims to develop a unified semantic segmentation model by utilizing multiple partially-labeled datasets, with each dataset providing labels for a single class of organs. However, the limited availability of labeled foreground organs and the absence of supervision to distinguish unlabeled foreground organs from the background pose a significant challenge, which leads to a distribution mismatch between labeled and unlabeled pixels. Although existing pseudo-labeling methods can be employed to learn from both labeled and unlabeled pixels, they are prone to performance degradation in this task, as they rely on the assumption that labeled and unlabeled pixels have the same distribution. In this paper, to address the problem of distribution mismatch, we propose a labeled-to-unlabeled distribution alignment (LTUDA) framework that aligns feature distributions and enhances discriminative capability. Specifically, we introduce a cross-set data augmentation strategy, which performs region-level mixing between labeled and unlabeled organs to reduce distribution discrepancy and enrich the training set. Besides, we propose a prototype-based distribution alignment method that implicitly reduces intra-class variation and increases the separation between the unlabeled foreground and background. This can be achieved by encouraging consistency between the outputs of two prototype classifiers and a linear classifier. Extensive experimental results on the AbdomenCT-1K dataset and a union of four benchmark datasets (including LiTS, MSD-Spleen, KiTS, and NIH82) demonstrate that our method outperforms the state-of-the-art partially-supervised methods by a considerable margin, and even surpasses the fully-supervised methods. The source code is publicly available at <a class="link-external link-https" href="https://github.com/xjiangmed/LTUDA" rel="external noopener nofollow">this https URL</a>.

Federated 3D multi-organ segmentation with partially labeled and unlabeled data

Federated Multi-organ Segmentation with Inconsistent Labels

Multi-site Organ Segmentation with Federated Partial Supervision and Site Adaptation

Federated learning with knowledge distillation for multi-organ segmentation with partially labeled datasets

Multi-organ segmentation: a progressive exploration of learning paradigms under scarce annotation

Partially Supervised Multi-organ Segmentation Via Affinity-Aware Consistency Learning and Cross Site Feature Alignment

Few-Shot 3D Volumetric Segmentation with Multi-Surrogate Fusion

Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentation

Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

Multi-organ Segmentation over Partially Labeled Datasets with Multi-scale Feature Abstraction

Unsupervised ensemble distillation for multi-organ segmentation

UniFed: A unified deep learning framework for segmentation of partially labelled, distributed neuroimaging data

Personalized federated learning for abdominal multi‐organ segmentation based on frequency domain aggregation

Semi-Supervised 3D Abdominal Multi-Organ Segmentation Via Deep Multi-Planar Co-Training

Multi-organ Segmentation via Co-training Weight-averaged Models from Few-organ Datasets

A multi-scale pyramid of 3D fully convolutional networks for abdominal multi-organ segmentation

Contour-aware network with class-wise convolutions for 3D abdominal multi-organ segmentation

Labeled-to-Unlabeled Distribution Alignment for Partially-Supervised Multi-Organ Medical Image Segmentation

Federated brain tumor segmentation: an extensive benchmark

MS-KD: Multi-Organ Segmentation with Multiple Binary-Labeled Datasets

Uncertainty-aware Incremental Learning for Multi-organ Segmentation