Abstract:Purposes Gadolinium based contrast agents (GBCAs) are widely administrated in MR imaging for diagnostic studies and treatment planning. Although GBCAs are generally thought to be safe, various health and environmental concerns have been raised recently about their use in MR imaging. The purpose of this work is to derive synthetic contrast enhance MR images from unenhanced counterpart images, thereby eliminating the need for GBCAs, using a cascade deep learning workflow that incorporates contour information into the network. Methods and Materials The proposed workflow consists of two sequential networks: 1) a retina U-Net, which is first trained to derive semantic features from the non-contrast MR images in representing the tumor regions, and 2) a synthesis module, which is trained after the retina U-Net to take the concatenation of the semantic feature maps and non-contrast MR image as input and to generate the synthetic contrast enhanced MR images. After network training, only the non-contrast enhanced MR images are required for the input in the proposed workflow. The MR images of 369 patients from the multimodal brain tumor segmentation challenge 2020 (BraTS2020) dataset were used in this study to evaluate the proposed workflow for synthesizing contrast enhanced MR images (200 patients for five-fold cross validation and 169 patients for hold-out test). Quantitative evaluations were conducted by calculating the normalized mean absolute error (NMAE), structural similarity index measurement (SSIM) and Pearson correlation coefficient (PCC). The original contrast enhanced MR images were considered as the ground truth in this analysis. Results The proposed cascade deep learning workflow synthesized contrast enhanced MR images that are not visually differentiable from the ground truth with and without supervision of the tumor contours during the network training. Difference images and profiles of the synthetic contrast enhanced MR images revealed that intensity differences could be observed in the tumor region if the contour information was not incorporated in network training. Among the hold-out test patients, mean values and standard deviations of the NMAE, SSIM and PCC were 0.063±0.022, 0.991±0.007 and 0.995±0.006, respectively, for the whole brain; and were 0.050±0.025, 0.993±0.008 and 0.999±0.003, respectively, for the tumor contour regions. Quantitative evaluations with five-fold cross validation and hold-out test showed that the calculated metrics can be significantly enhanced (p-values ≤ 0.002) with the tumor contour supervision in network training. Conclusion The proposed workflow was able to generate synthetic contrast enhanced MR images that closely resemble the ground truth images from non-contrast enhanced MR images when the network training included tumor contours. These results suggest that it may be possible to minimize the use of GBCAs in cranial MR imaging studies. This article is protected by copyright. All rights reserved

A multi-task generative model for simultaneous post-contrast MR image synthesis and brainstem glioma segmentation

High Tissue Contrast MRI Synthesis Using Multi-Stage Attention-GAN for Glioma Segmentation

T1-contrast Enhanced MRI Generation from Multi-parametric MRI for Glioma Patients with Latent Tumor Conditioning

Synthesizing MR Image Contrast Enhancement Using 3D High-Resolution ConvNets

Improvement of Multiparametric MR Image Segmentation by Augmenting the Data With Generative Adversarial Networks for Glioma Patients

Synthesis of gadolinium‐enhanced glioma images on multisequence magnetic resonance images using contrastive learning

MRI Contrast Enhancement Synthesis Using Cascade Networks with Local Supervision

Magnetic Resonance Imaging Contrast Enhancement Synthesis Using Cascade Networks with Local Supervision

Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

Brain Tumor Synthetic Segmentation in 3D Multimodal MRI Scans

Synthesizing Contrast-Enhanced MR Images from Noncontrast MR Images Using Deep Learning

Conditional Generative Models for Contrast-Enhanced Synthesis of T1w and T1 Maps in Brain MRI

DualMMP-GAN: Dual-scale Multi-Modality Perceptual Generative Adversarial Network for Medical Image Segmentation

Nimg-65. Synthetic Mri Generation To Facilitate Autosegmentation Of Pediatric Brain Tumors In Limited Data Scenarios

Automatic Brain Tissue and Lesion Segmentation and Multi-Parametric Mapping of Contrast-Enhancing Gliomas without the Injection of Contrast Agents: A Preliminary Study

Generative adversarial network-based synthesis of contrast-enhanced MR images from precontrast images for predicting histological characteristics in breast cancer

Lesion Mask-based Simultaneous Synthesis of Anatomic and MolecularMR Images using a GAN

Deep learning-based 3D MRI contrast-enhanced synthesis from a 2D noncontrast T2Flair sequence

Synthesize High-Quality Multi-Contrast Magnetic Resonance Imaging from Multi-Echo Acquisition Using Multi-Task Deep Generative Model

Image synthesis in contrast MRI based on super resolution reconstruction with multi-refinement cycle-consistent generative adversarial networks

Medical image synthesis via conditional GANs: Application to segmenting brain tumours