Abstract:BACKGROUNDThe availability of standard multiparametric MRI sequences, including pre-contrast T1w (T1w-pre), post-contrast T1w (T1w-post), T2w, and FLAIR images, is essential for accurate segmentation of tumor subregions and subsequent response assessment in pediatric brain tumors (PBTs). However, clinical MRI sets are often incomplete due to imaging artifacts or inconsistent acquisition protocols across different centers. This study leverages Generative Adversarial Networks (GANs) to synthesize missing FLAIR and T1w-pre images from T2w and T1w-post images, respectively, to facilitate tumor segmentation in PBTs. METHODSWe developed two GAN models based on the pix2pix framework, trained, validated, and tested on FLAIR-T2w and T1w-post-T1w-pre pairs from a multi-histology and multi-institutional cohort of 476 subjects with PBTs from the Children's Brain Tumor Network (CBTN). The perceptual quality of the synthesized T1w-pre and FLAIR images was evaluated using the Structural Similarity Index (SSI; ideal value = 1). The robustness of the synthesized sequences to replace missing MRI sequences was evaluated by comparing the segmentation performance (Dice score) of our pre-trained autosegmentation model using all real modalities versus replacing real sequences with their synthesized counterparts. RESULTSThe T1w-pre and FLAIR synthesis GANs achieved mean SSI values of 0.95 and 0.93, respectively. Median Dice scores for segmentation of whole tumor (WT), enhancing tumor (ET), and tumor core (TC) were calculated for real sequences: 0.90, 0.83, 0.89, replacing real FLAIR with synthetic: 0.86, 0.81, 0.86, and replacing real T1w-pre with synthetic: 0.90, 0.75, 0.89. No statistical significance (p>0.05) was observed in segmentation performance for WT, TC, ET when replacing real T1w-pre with synthetic, and for ET when replacing real with synthetic FLAIR sequences. CONCLUSIONThis method achieves robust segmentation performance in limited data scenarios by synthesizing missing MRI sequences. Future work includes improving FLAIR synthesis and segmentation performance for WT and ET by implementing and comparing other GAN architectures.

Synthesizing Missing MRI Sequences from Available Modalities using Generative Adversarial Networks in BraTS Dataset

Generating 3D Brain Tumor Regions in MRI using Vector-Quantization Generative Adversarial Networks

Nimg-65. Synthetic Mri Generation To Facilitate Autosegmentation Of Pediatric Brain Tumors In Limited Data Scenarios

Brain Tumor Synthetic Segmentation in 3D Multimodal MRI Scans

How we won BraTS 2023 Adult Glioma challenge? Just faking it! Enhanced Synthetic Data Augmentation and Model Ensemble for brain tumour segmentation

Generative Adversarial Networks for Weakly Supervised Generation and Evaluation of Brain Tumor Segmentations on MR Images

Multi-modal brain tumor segmentation via conditional synthesis with Fourier domain adaptation

The 2024 Brain Tumor Segmentation (BraTS) Challenge: Glioma Segmentation on Post-treatment MRI

Multimodal CNN Networks for Brain Tumor Segmentation in MRI: A BraTS 2022 Challenge Solution

Brain tumor image generation using an aggregation of GAN models with style transfer

Improved Multi-Task Brain Tumour Segmentation with Synthetic Data Augmentation

Automated Ensemble-Based Segmentation of Adult Brain Tumors: A Novel Approach Using the BraTS AFRICA Challenge Data

Using a generative adversarial network to generate synthetic MRI images for multi-class automatic segmentation of brain tumors

Development of brain tumor radiogenomic classification using GAN-based augmentation of MRI slices in the newly released gazi brains dataset

Improvement of Multiparametric MR Image Segmentation by Augmenting the Data With Generative Adversarial Networks for Glioma Patients

Cross-Modality Augmentation Of Brain Mr Images Using A Novel Pairwise Generative Adversarial Network For Enhanced Glioma Classification

Ensemble CNN Networks for GBM Tumors Segmentation using Multi-parametric MRI

Brain tumor image pixel segmentation and detection using an aggregation of GAN models with vision transformer

Attention-Enhanced Hybrid Feature Aggregation Network for 3D Brain Tumor Segmentation

Ensemble Learning and 3D Pix2Pix for Comprehensive Brain Tumor Analysis in Multimodal MRI

Synthetic Brain Images: Bridging the Gap in Brain Mapping With Generative Adversarial Model