Abstract:Brain tumor diagnostics rely heavily on Magnetic Resonance Imaging (MRI) for accurate diagnosis and treatment planning due to its non-invasive nature and detailed soft tissue visualization. Integrating multiple MRI modalities enhances diagnostic precision by providing complementary perspectives on tumor characteristics and spatial relationships. However, acquiring specific modalities like T1 Contrast Enhanced (T1CE) can be challenging, as they require contrast agents and longer scan times, which can cause discomfort, particularly in vulnerable patient groups such as the elderly, pregnant women, and infants. In the medical imaging domain, researchers face significant challenges in developing robust models due to data scarcity and data sparsity. Data scarcity, arising from limited access to diverse datasets, complex annotation processes, privacy concerns, and the difficulty of acquiring certain modalities in some patient groups, impedes the development of comprehensive brain tumor segmentation models. Data sparsity, driven by the highly imbalanced distribution between tumor subregions and background levels in annotated labels, complicates accurate segmentation. The study addresses these challenges by generating synthetic T1CE scans from T1 using an image-to-image translation framework, thereby reducing the reliance on hard-to-acquire modalities. A novel patch-based data sampling approach, Adaptive Random Patch Selection (ARPS), is introduced to combat data sparsity, ensuring detailed segmentation of intricate tumor structures while maintaining context through overlapping patches and context-aware sampling strategies. The impact of these synthetic images on segmentation performance is also assessed, emphasizing their role in addressing situations where certain modalities cannot be acquired. When integrated into the nnUNet model, this approach achieves a dice similarity coefficient (DSC) of 86.47, demonstrating its efficacy in handling complex MRI scans of brain tumors. An ablation study is also conducted to assess the individual contributions of the translated images and the proposed data sampling approach. This comprehensive evaluation allows us to understand the effectiveness of ARPS and the potential synergy between multi-modal translation and brain tumor segmentation.

One-Shot Generative Adversarial Learning for MRI Segmentation of Craniomaxillofacial Bony Structures.

Craniomaxillofacial Bony Structures Segmentation from MRI with Deep-Supervision Adversarial Learning

Mask-guided generative adversarial network for MRI-based CT synthesis

MouseGAN++: Unsupervised Disentanglement and Contrastive Representation for Multiple MRI Modalities Synthesis and Structural Segmentation of Mouse Brain

MCMT-GAN: Multi-Task Coherent Modality Transferable GAN for 3D Brain Image Synthesis.

A Deep Learning Model for Multi-Domain MRI Synthesis Using Generative Adversarial Networks

High Tissue Contrast MRI Synthesis Using Multi-Stage Attention-GAN for Glioma Segmentation

SUSAN: Segment Unannotated image Structure using Adversarial Network

MM-GAN: 3D MRI Data Augmentation for Medical Image Segmentation Via Generative Adversarial Networks

PSIGAN: Joint probabilistic segmentation and image distribution matching for unpaired cross-modality adaptation based MRI segmentation

DualMMP-GAN: Dual-scale Multi-Modality Perceptual Generative Adversarial Network for Medical Image Segmentation

MRI restoration using edge-guided adversarial learning

Improving segmentation reliability of multi-scanner brain images using a generative adversarial network

Semi-supervised Learning Approach to Generate Neuroimaging Modalities with Adversarial Training

Synthetic MRI in action: A novel framework in data augmentation strategies for robust multi-modal brain tumor segmentation

Modeling the Probabilistic Distribution of Unlabeled Data forOne-shot Medical Image Segmentation

A weakly supervised model for incomplete multimodal MRI synthesis with tumor‐aware approach

Multi-planar dual adversarial network based on dynamic 3D features for MRI-CT head and neck image synthesis

Shape-Consistent Generative Adversarial Networks for Multi-Modal Medical Segmentation Maps

Generative Learning-Based Lightweight MRI Brain Tumor Segmentation with Missing Modalities

DiamondGAN: Unified Multi-Modal Generative Adversarial Networks for MRI Sequences Synthesis