Abstract:Deep reinforcement learning (DRL) has demonstrated impressive performance in medical image segmentation, particularly for low-contrast and small medical objects. However, current DRL-based segmentation methods face limitations due to the optimization of error propagation in two separate stages and the need for a significant amount of labeled data. In this paper, we propose a novel deep generative adversarial reinforcement learning (DGARL) approach that, for the first time, enables end-to-end semi-supervised medical image segmentation in the DRL domain. DGARL ingeniously establishes a pipeline that integrates DRL and generative adversarial networks (GANs) to optimize both detection and segmentation tasks holistically while mutually enhancing each other. Specifically, DGARL introduces two innovative components to facilitate this integration in semi-supervised settings. First, a task-joint GAN with two discriminators links the detection results to the GAN's segmentation performance evaluation, allowing simultaneous joint evaluation and feedback. This ensures that DRL and GAN can be directly optimized based on each other's results. Second, a bidirectional exploration DRL integrates backward exploration and forward exploration to ensure the DRL agent explores the correct direction when forward exploration is disabled due to lack of explicit rewards. This mitigates the issue of unlabeled data being unable to provide rewards and rendering DRL unexplorable. Comprehensive experiments on three generalization datasets, comprising a total of 640 patients, demonstrate that our novel DGARL achieves 85.02% Dice and improves at least 1.91% for brain tumors, achieves 73.18% Dice and improves at least 4.28% for liver tumors, and achieves 70.85% Dice and improves at least 2.73% for pancreas compared to the ten most recent advanced methods, our results attest to the superiority of DGARL. Code is available at GitHub.

Deep Learning Segmentation of Spiral Arms and Bars

A morphological segmentation approach to determining bar lengths

Quantifying the fine structures of disk galaxies with deep learning:Segmentation of spiral arms in different Hubble types

End-Face Localization and Segmentation of Steel Bar Based on Convolution Neural Network.

Scalable Automated Detection of Spiral Galaxy Arm Segments

Panoptic Segmentation of Galactic Structures in LSB Images

Spin Parity of Spiral Galaxies II: A catalogue of 80k spiral galaxies using big data from the Subaru Hyper Suprime-Cam Survey and deep learning

Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation

Detecting the edges of galaxies with deep learning

Automated Detection of Galactic Rings from SDSS Images

Galaxy Zoo DECaLS: Detailed Visual Morphology Measurements from Volunteers and Deep Learning for 314,000 Galaxies

LDLS: 3-D Object Segmentation Through Label Diffusion From 2-D Images

Explaining deep learning of galaxy morphology with saliency mapping

Deep Learning for Morphological Identification of Extended Radio Galaxies using Weak Labels

Advancing Galaxy Analysis: AI-Powered Detection and Segmentation of Edge-On Galaxies

Deep learning for galaxy surface brightness profile fitting

GReFC-Net: an automated method for measuring structural features of spiral galaxies

Automatic Search for Low-surface-brightness Galaxies from Sloan Digital Sky Survey Images Using Deep Learning

Deep Generative Adversarial Reinforcement Learning for Semi-Supervised Segmentation of Low-Contrast and Small Objects in Medical Images