Abstract:Deep reinforcement learning (DRL) has demonstrated impressive performance in medical image segmentation, particularly for low-contrast and small medical objects. However, current DRL-based segmentation methods face limitations due to the optimization of error propagation in two separate stages and the need for a significant amount of labeled data. In this paper, we propose a novel deep generative adversarial reinforcement learning (DGARL) approach that, for the first time, enables end-to-end semi-supervised medical image segmentation in the DRL domain. DGARL ingeniously establishes a pipeline that integrates DRL and generative adversarial networks (GANs) to optimize both detection and segmentation tasks holistically while mutually enhancing each other. Specifically, DGARL introduces two innovative components to facilitate this integration in semi-supervised settings. First, a task-joint GAN with two discriminators links the detection results to the GAN's segmentation performance evaluation, allowing simultaneous joint evaluation and feedback. This ensures that DRL and GAN can be directly optimized based on each other's results. Second, a bidirectional exploration DRL integrates backward exploration and forward exploration to ensure the DRL agent explores the correct direction when forward exploration is disabled due to lack of explicit rewards. This mitigates the issue of unlabeled data being unable to provide rewards and rendering DRL unexplorable. Comprehensive experiments on three generalization datasets, comprising a total of 640 patients, demonstrate that our novel DGARL achieves 85.02% Dice and improves at least 1.91% for brain tumors, achieves 73.18% Dice and improves at least 4.28% for liver tumors, and achieves 70.85% Dice and improves at least 2.73% for pancreas compared to the ten most recent advanced methods, our results attest to the superiority of DGARL. Code is available at GitHub.

MRL-Seg: Overcoming Imbalance in Medical Image Segmentation With Multi-Step Reinforcement Learning

MsVRL: Self-Supervised Multiscale Visual Representation Learning Via Cross-Level Consistency for Medical Image Segmentation

Iteratively-Refined Interactive 3D Medical Image Segmentation with Multi-Agent Reinforcement Learning

RWMS: Reliable Weighted Multi-Phase for Semi-supervised Segmentation

MMSeg: A novel multi-task learning framework for class imbalance and label scarcity in medical image segmentation

Multi-step Segmentation for Prostate MR Image Based on Reinforcement Learning

RLSegNet: An Medical Image Segmentation Network Based on Reinforcement Learning

Medical Image Segmentation Algorithm for Three-Dimensional Multimodal Using Deep Reinforcement Learning and Big Data Analytics

Consistency-guided Meta-Learning for Bootstrapping Semi-Supervised Medical Image Segmentation

Boundary-aware Supervoxel-level Iteratively Refined Interactive 3D Image Segmentation with Multi-agent Reinforcement Learning

An Efficient Semi-Supervised Framework with Multi-Task and Curriculum Learning for Medical Image Segmentation

Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learning

A General Framework for Context-Specific Image Segmentation Using Reinforcement Learning

Generalizable Medical Image Segmentation via Random Amplitude Mixup and Domain-Specific Image Restoration

Generalizable Medical Image Segmentation via Random Amplitude Mixup and Domain-Specific Image Restoration.

Multi-rater Prism: Learning self-calibrated medical image segmentation from multiple raters

Multi-task contrastive learning for semi-supervised medical image segmentation with multi-scale uncertainty estimation

Interactive medical image segmentation with self-adaptive confidence calibration

LSRML: A latent space regularization based meta-learning framework for MR image segmentation

Deep Generative Adversarial Reinforcement Learning for Semi-Supervised Segmentation of Low-Contrast and Small Objects in Medical Images

AHU-MultiNet: Adaptive loss balancing based on homoscedastic uncertainty in multi-task medical image segmentation network