Abstract:BACKGROUNDThe availability of standard multiparametric MRI sequences, including pre-contrast T1w (T1w-pre), post-contrast T1w (T1w-post), T2w, and FLAIR images, is essential for accurate segmentation of tumor subregions and subsequent response assessment in pediatric brain tumors (PBTs). However, clinical MRI sets are often incomplete due to imaging artifacts or inconsistent acquisition protocols across different centers. This study leverages Generative Adversarial Networks (GANs) to synthesize missing FLAIR and T1w-pre images from T2w and T1w-post images, respectively, to facilitate tumor segmentation in PBTs. METHODSWe developed two GAN models based on the pix2pix framework, trained, validated, and tested on FLAIR-T2w and T1w-post-T1w-pre pairs from a multi-histology and multi-institutional cohort of 476 subjects with PBTs from the Children's Brain Tumor Network (CBTN). The perceptual quality of the synthesized T1w-pre and FLAIR images was evaluated using the Structural Similarity Index (SSI; ideal value = 1). The robustness of the synthesized sequences to replace missing MRI sequences was evaluated by comparing the segmentation performance (Dice score) of our pre-trained autosegmentation model using all real modalities versus replacing real sequences with their synthesized counterparts. RESULTSThe T1w-pre and FLAIR synthesis GANs achieved mean SSI values of 0.95 and 0.93, respectively. Median Dice scores for segmentation of whole tumor (WT), enhancing tumor (ET), and tumor core (TC) were calculated for real sequences: 0.90, 0.83, 0.89, replacing real FLAIR with synthetic: 0.86, 0.81, 0.86, and replacing real T1w-pre with synthetic: 0.90, 0.75, 0.89. No statistical significance (p>0.05) was observed in segmentation performance for WT, TC, ET when replacing real T1w-pre with synthetic, and for ET when replacing real with synthetic FLAIR sequences. CONCLUSIONThis method achieves robust segmentation performance in limited data scenarios by synthesizing missing MRI sequences. Future work includes improving FLAIR synthesis and segmentation performance for WT and ET by implementing and comparing other GAN architectures.

Multi-modal brain tumor segmentation via conditional synthesis with Fourier domain adaptation

Medical image synthesis via conditional GANs: Application to segmenting brain tumours

Brain Tumor Synthetic Segmentation in 3D Multimodal MRI Scans

Improvement of Multiparametric MR Image Segmentation by Augmenting the Data With Generative Adversarial Networks for Glioma Patients

Nimg-65. Synthetic Mri Generation To Facilitate Autosegmentation Of Pediatric Brain Tumors In Limited Data Scenarios

Using a generative adversarial network to generate synthetic MRI images for multi-class automatic segmentation of brain tumors

Synthesizing 3D Multi-Contrast Brain Tumor MRIs Using Tumor Mask Conditioning

Brain tumor segmentation using synthetic MR images -- A comparison of GANs and diffusion models

Lesion Mask-based Simultaneous Synthesis of Anatomic and MolecularMR Images using a GAN

TumorGAN: A Multi-Modal Data Augmentation Framework for Brain Tumor Segmentation

Evaluating synthetic neuroimaging data augmentation for automatic brain tumour segmentation with a deep fully-convolutional network

3-D PET Image Generation with tumour masks using TGAN

BTMF-GAN: A Multi-Modal MRI Fusion Generative Adversarial Network for Brain Tumors

Generating 3D Brain Tumor Regions in MRI using Vector-Quantization Generative Adversarial Networks

Ensemble Learning and 3D Pix2Pix for Comprehensive Brain Tumor Analysis in Multimodal MRI

MCMT-GAN: Multi-Task Coherent Modality Transferable GAN for 3D Brain Image Synthesis.

Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

Synthesizing Missing MRI Sequences from Available Modalities using Generative Adversarial Networks in BraTS Dataset

Brain tumor image pixel segmentation and detection using an aggregation of GAN models with vision transformer

Brain tumor image generation using an aggregation of GAN models with style transfer

High Tissue Contrast MRI Synthesis Using Multi-Stage Attention-GAN for Glioma Segmentation