Abstract:Purpose: Gadolinium‐based contrast agents (GBCAs) have been successfully applied in magnetic resonance (MR) imaging to facilitate better lesion visualization. However, gadolinium deposition in the human brain raised widespread concerns recently. On the other hand, although high‐resolution three‐dimensional (3D) MR images are more desired for most existing medical image processing algorithms, their long scan duration and high acquiring costs make 2D MR images still much more common clinically. Therefore, developing alternative solutions for 3D contrast‐enhanced MR images synthesis to replace GBCAs injection becomes an urgent requirement.Methods: This study proposed a deep learning framework that produces 3D isotropic full‐contrast T2Flair images from 2D anisotropic non‐contrast T2Flair image stacks. The super‐resolution (SR) and contrast‐enhanced (CE) synthesis tasks are completed in sequence by using an identical generative adversarial network (GAN) with the same techniques. To solve the problem that intra‐modality datasets from different scanners have specific combinations of orientations, contrasts and resolutions, we conducted a region‐based data augmentation technique on the fly during training to simulate various imaging protocols in the clinic. We further improved our network by introducing atrous spatial pyramid pooling, enhanced residual blocks and deep supervision for better quantitative and qualitative results.Results: Our proposed method achieved superior CE synthesized performance in quantitative metrics and perceptual evaluation. Detailedly, the PSNR, SSIM and AUC are 32.25 dB, 0.932 and 0.991 in the whole brain and 24.93 dB, 0.851 and 0.929 in tumor regions. The radiologists' evaluations confirmed that our proposed method has high confidence in the diagnosis. Analysis of the generalization ability showed that benefiting from the proposed data augmentation technique, our network can be applied to 'unseen' datasets with slight drops in quantitative and qualitative results.Conclusion: Our work demonstrates the clinical potential of synthesizing diagnostic 3D isotropic CE brain MR images from a single 2D anisotropic non‐contrast sequence.This article is protected by copyright. All rights reserved

Synthesizing Multi-Contrast MR Images Via Novel 3D Conditional Variational Auto-Encoding GAN

Synthesizing Contrast-enhanced Computed Tomography Images with an Improved Conditional Generative Adversarial Network

A Novel Method Of Synthetic Ct Generation From Mr Images Based On Convolutional Neural Networks

OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

Unpaired Multi-contrast MR Image Synthesis Using Generative Adversarial Networks.

Multimodal MR Image Synthesis Using Gradient Prior and Adversarial Learning

Deep learning-based 3D MRI contrast-enhanced synthesis from a 2D noncontrast T2Flair sequence

Image synthesis in contrast MRI based on super resolution reconstruction with multi-refinement cycle-consistent generative adversarial networks

HybridGAN: Hybrid Generative Adversarial Networks for MR Image Synthesis

Multi-Conditional Constraint Generative Adversarial Network-Based MR Imaging from CT Scan Data

Mask-guided generative adversarial network for MRI-based CT synthesis

Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networks

Enhanced Magnetic Resonance Image Synthesis with Contrast-Aware Generative Adversarial Networks

Hybrid Generative Adversarial Networks for Deep MR to CT Synthesis Using Unpaired Data

LR-cGAN: Latent representation based conditional generative adversarial network for multi-modality MRI synthesis

Synthesizing MR Image Contrast Enhancement Using 3D High-Resolution ConvNets

MCMT-GAN: Multi-Task Coherent Modality Transferable GAN for 3D Brain Image Synthesis.

Deep Learning‐Based 3D MRI Contrast‐Enhanced Synthesis From A 2D Non‐contrast T2Flair Sequence Deep Learning, MR images Synthesis

Attention-Based Multi-Scale Generative Adversarial Network for synthesizing contrast-enhanced MRI

MRI-Trans-GAN: 3D MRI Cross-Modality Translation

ReeGAN: MRI image edge-preserving synthesis based on GANs trained with misaligned data