Abstract:Background: AI-assisted polyp segmentation in colonoscopy plays a crucial role in enabling prompt diagnosis and treatment of colorectal cancer. However, the lack of sufficient annotated data poses a significant challenge for supervised learning approaches. Existing semi-supervised learning methods also suffer from performance degradation, mainly due to task-specific characteristics, such as class imbalance in polyp segmentation. Purpose: The purpose of this work is to develop an effective semi-supervised learning framework for accurate polyp segmentation in colonoscopy, addressing limited annotated data and class imbalance challenges. Methods: We proposed PolypMixNet, a semi-supervised framework, for colorectal polyp segmentation, utilizing novel augmentation techniques and a Mean Teacher architecture to improve model performance. PolypMixNet introduces the polyp-aware mixup (PolypMix) algorithm and incorporates dual-level consistency regularization. PolypMix addresses the class imbalance in colonoscopy datasets and enhances the diversity of training data. By performing a polyp-aware mixup on unlabeled samples, it generates mixed images with polyp context along with their artificial labels. A polyp-directed soft pseudo-labeling (PDSPL) mechanism was proposed to generate high-quality pseudo labels and eliminate the dilution of lesion features caused by mixup operations. To ensure consistency in the training phase, we introduce the PolypMix prediction consistency (PMPC) loss and PolypMix attention consistency (PMAC) loss, enforcing consistency at both image and feature levels. Code is available at https://github.com/YChienHung/PolypMix. Results: PolypMixNet was evaluated on four public colonoscopy datasets, achieving 88.97% Dice and 88.85% mIoU on the benchmark dataset of Kvasir-SEG. In scenarios where the labeled training data is limited to 15%, PolypMixNet outperforms the state-of-the-art semi-supervised approaches with a 2.88-point improvement in Dice. It also shows the ability to reach performance comparable to the fully supervised counterpart. Additionally, we conducted extensive ablation studies to validate the effectiveness of each module and highlight the superiority of our proposed approach. Conclusion: PolypMixNet effectively addresses the challenges posed by limited annotated data and unbalanced class distributions in polyp segmentation. By leveraging unlabeled data and incorporating novel augmentation and consistency regularization techniques, our method achieves state-of-the-art performance. We believe that the insights and contributions presented in this work will pave the way for further advancements in semi-supervised polyp segmentation and inspire future research in the medical imaging domain.

Non-equivalent images and pixels: Confidence-aware resampling with meta-learning mixup for polyp segmentation

PolypMixNet: Enhancing semi-supervised polyp segmentation with polyp-aware augmentation

Learn to Threshold: ThresholdNet With Confidence-Guided Manifold Mixup for Polyp Segmentation

MixPolyp: Integrating Mask, Box and Scribble Supervision for Enhanced Polyp Segmentation

Dataset-level Color Augmentation and Multi-scale Exploration Methods for Polyp Segmentation

Adaptive Mix for Semi-Supervised Medical Image Segmentation

ModelMix: A New Model-Mixup Strategy to Minimize Vicinal Risk across Tasks for Few-scribble based Cardiac Segmentation

Probabilistic Modeling Ensemble Vision Transformer Improves Complex Polyp Segmentation

Single-Modality Endoscopic Polyp Segmentation Via Random Color Reversal Synthesis and Two-Branched Learning

Self-Supervised and Semi-Supervised Polyp Segmentation using Synthetic Data

Polyp segmentation with interference filtering and dynamic uncertainty mining

S$^2$ME: Spatial-Spectral Mutual Teaching and Ensemble Learning for Scribble-supervised Polyp Segmentation

Polyp-Mamba: A Hybrid Multi-Frequency Perception Gated Selection Network for polyp segmentation

Boosting few-shot confocal endomicroscopy image recognition with feature-level MixSiam

Multi-scale Information Sharing and Selection Network with Boundary Attention for Polyp Segmentation

Polyp-E: Benchmarking the Robustness of Deep Segmentation Models via Polyp Editing

LCAMix: Local-and-contour aware grid mixing based data augmentation for medical image segmentation

PCLMix: Weakly Supervised Medical Image Segmentation via Pixel-Level Contrastive Learning and Dynamic Mix Augmentation

MCE-Net: polyp segmentation with multiple branch series-parallel attention and channel interaction via edge distribution guidance

Automated polyp segmentation based on a multi-distance feature dissimilarity-guided fully convolutional network

Colorectal polyp segmentation with denoising diffusion probabilistic models