Abstract:BACKGROUNDThe availability of standard multiparametric MRI sequences, including pre-contrast T1w (T1w-pre), post-contrast T1w (T1w-post), T2w, and FLAIR images, is essential for accurate segmentation of tumor subregions and subsequent response assessment in pediatric brain tumors (PBTs). However, clinical MRI sets are often incomplete due to imaging artifacts or inconsistent acquisition protocols across different centers. This study leverages Generative Adversarial Networks (GANs) to synthesize missing FLAIR and T1w-pre images from T2w and T1w-post images, respectively, to facilitate tumor segmentation in PBTs. METHODSWe developed two GAN models based on the pix2pix framework, trained, validated, and tested on FLAIR-T2w and T1w-post-T1w-pre pairs from a multi-histology and multi-institutional cohort of 476 subjects with PBTs from the Children's Brain Tumor Network (CBTN). The perceptual quality of the synthesized T1w-pre and FLAIR images was evaluated using the Structural Similarity Index (SSI; ideal value = 1). The robustness of the synthesized sequences to replace missing MRI sequences was evaluated by comparing the segmentation performance (Dice score) of our pre-trained autosegmentation model using all real modalities versus replacing real sequences with their synthesized counterparts. RESULTSThe T1w-pre and FLAIR synthesis GANs achieved mean SSI values of 0.95 and 0.93, respectively. Median Dice scores for segmentation of whole tumor (WT), enhancing tumor (ET), and tumor core (TC) were calculated for real sequences: 0.90, 0.83, 0.89, replacing real FLAIR with synthetic: 0.86, 0.81, 0.86, and replacing real T1w-pre with synthetic: 0.90, 0.75, 0.89. No statistical significance (p>0.05) was observed in segmentation performance for WT, TC, ET when replacing real T1w-pre with synthetic, and for ET when replacing real with synthetic FLAIR sequences. CONCLUSIONThis method achieves robust segmentation performance in limited data scenarios by synthesizing missing MRI sequences. Future work includes improving FLAIR synthesis and segmentation performance for WT and ET by implementing and comparing other GAN architectures.

Evaluating synthetic neuroimaging data augmentation for automatic brain tumour segmentation with a deep fully-convolutional network

Improvement of Multiparametric MR Image Segmentation by Augmenting the Data With Generative Adversarial Networks for Glioma Patients

Nimg-65. Synthetic Mri Generation To Facilitate Autosegmentation Of Pediatric Brain Tumors In Limited Data Scenarios

Learning Data Augmentation for Brain Tumor Segmentation with Coarse-to-Fine Generative Adversarial Networks

Brain tumor segmentation using synthetic MR images -- A comparison of GANs and diffusion models

Multi-modal brain tumor segmentation via conditional synthesis with Fourier domain adaptation

Non Parametric Data Augmentations Improve Deep-Learning based Brain Tumor Segmentation

Quantitative and Visual Analysis of Data Augmentation and Hyperparameter Optimization in Deep Learning-Based Segmentation of Low-Grade Glioma Tumors Using Grad-CAM

Brain tumor image generation using an aggregation of GAN models with style transfer

Cross-Modality Augmentation Of Brain Mr Images Using A Novel Pairwise Generative Adversarial Network For Enhanced Glioma Classification

Using a generative adversarial network to generate synthetic MRI images for multi-class automatic segmentation of brain tumors

GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks

Lesion Mask-based Simultaneous Synthesis of Anatomic and MolecularMR Images using a GAN

Medical image synthesis via conditional GANs: Application to segmenting brain tumours

Development of brain tumor radiogenomic classification using GAN-based augmentation of MRI slices in the newly released gazi brains dataset

Synthesis of Brain Tumor MR Images for Learning Data Augmentation

TumorGAN: A Multi-Modal Data Augmentation Framework for Brain Tumor Segmentation

Deepfake Image Generation for Improved Brain Tumor Segmentation

Synthesizing brain tumor images and annotations by combining progressive growing GAN and SPADE

Data Augmentation For Medical MR Image Using Generative Adversarial Networks

Self-supervised Brain Lesion Generation for Effective Data Augmentation of Medical Images