Abstract:Deep reinforcement learning (DRL) has demonstrated impressive performance in medical image segmentation, particularly for low-contrast and small medical objects. However, current DRL-based segmentation methods face limitations due to the optimization of error propagation in two separate stages and the need for a significant amount of labeled data. In this paper, we propose a novel deep generative adversarial reinforcement learning (DGARL) approach that, for the first time, enables end-to-end semi-supervised medical image segmentation in the DRL domain. DGARL ingeniously establishes a pipeline that integrates DRL and generative adversarial networks (GANs) to optimize both detection and segmentation tasks holistically while mutually enhancing each other. Specifically, DGARL introduces two innovative components to facilitate this integration in semi-supervised settings. First, a task-joint GAN with two discriminators links the detection results to the GAN's segmentation performance evaluation, allowing simultaneous joint evaluation and feedback. This ensures that DRL and GAN can be directly optimized based on each other's results. Second, a bidirectional exploration DRL integrates backward exploration and forward exploration to ensure the DRL agent explores the correct direction when forward exploration is disabled due to lack of explicit rewards. This mitigates the issue of unlabeled data being unable to provide rewards and rendering DRL unexplorable. Comprehensive experiments on three generalization datasets, comprising a total of 640 patients, demonstrate that our novel DGARL achieves 85.02% Dice and improves at least 1.91% for brain tumors, achieves 73.18% Dice and improves at least 4.28% for liver tumors, and achieves 70.85% Dice and improves at least 2.73% for pancreas compared to the ten most recent advanced methods, our results attest to the superiority of DGARL. Code is available at GitHub.

Multi-step Segmentation for Prostate MR Image Based on Reinforcement Learning

MsVRL: Self-Supervised Multiscale Visual Representation Learning Via Cross-Level Consistency for Medical Image Segmentation

Iteratively-Refined Interactive 3D Medical Image Segmentation with Multi-Agent Reinforcement Learning

MRL-Seg: Overcoming Imbalance in Medical Image Segmentation With Multi-Step Reinforcement Learning

Semi-Supervised and Self-Supervised Collaborative Learning for Prostate 3D MR Image Segmentation

Application of reinforcement learning for segmentation of transrectal ultrasound images

Medical Image Segmentation Algorithm for Three-Dimensional Multimodal Using Deep Reinforcement Learning and Big Data Analytics

Deep Generative Adversarial Reinforcement Learning for Semi-Supervised Segmentation of Low-Contrast and Small Objects in Medical Images

Deep reinforcement learning architectures for automatic organ segmentation

An Automatic Ultrasonic Segmentation Method by Two-stage Semi-supervised Learning Strategy

Boundary-aware Supervoxel-level Iteratively Refined Interactive 3D Image Segmentation with Multi-agent Reinforcement Learning

Attention-guided multi-scale learning network for automatic prostate and tumor segmentation on MRI

Deep Learning Based Dominant Index Lesion Segmentation for MR-guided Radiation Therapy of Prostate Cancer

Automatic Prostate MR Image Segmentation with Sparse Label Propagation and Domain-Specific Manifold Regularization

Segmentation for Multimodal Brain Tumor Images Using Dual-Tree Complex Wavelet Transform and Deep Reinforcement Learning

Transfer Learning with Edge Attention for Prostate MRI Segmentation

Deep learning in magnetic resonance prostate segmentation: A review and a new perspective

Collaborative Learning for Annotation-Efficient Volumetric MR Image Segmentation

Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learning

Research on the segmentation method of prostate magnetic resonance image based on level set

A dynamic interactive learning framework for automated 3D medical image segmentation