Abstract:Purpose Gadolinium-based contrast agents (GBCAs) have been successfully applied in magnetic resonance (MR) imaging to facilitate better lesion visualization. However, gadolinium deposition in the human brain raised widespread concerns recently. On the other hand, although high-resolution three-dimensional (3D) MR images are more desired for most existing medical image processing algorithms, their long scan duration and high acquiring costs make 2D MR images still much more common clinically. Therefore, developing alternative solutions for 3D contrast-enhanced MR image synthesis to replace GBCAs injection becomes an urgent requirement. Methods This study proposed a deep learning framework that produces 3D isotropic full-contrast T2Flair images from 2D anisotropic noncontrast T2Flair image stacks. The super-resolution (SR) and contrast-enhanced (CE) synthesis tasks are completed in sequence by using an identical generative adversarial network (GAN) with the same techniques. To solve the problem that intramodality datasets from different scanners have specific combinations of orientations, contrasts, and resolutions, we conducted a region-based data augmentation technique on the fly during training to simulate various imaging protocols in the clinic. We further improved our network by introducing atrous spatial pyramid pooling, enhanced residual blocks, and deep supervision for better quantitative and qualitative results. Results Our proposed method achieved superior CE-synthesized performance in quantitative metrics and perceptual evaluation. In detail, the PSNR, structural-similarity-index, and AUC are 32.25 dB, 0.932, and 0.991 in the whole brain and 24.93 dB, 0.851, and 0.929 in tumor regions. The radiologists' evaluations confirmed that our proposed method has high confidence in the diagnosis. Analysis of the generalization ability showed that benefiting from the proposed data augmentation technique, our network can be applied to "unseen" datasets with slight drops in quantitative and qualitative results. Conclusion Our work demonstrates the clinical potential of synthesizing diagnostic 3D isotropic CE brain MR images from a single 2D anisotropic noncontrast sequence.

UltimateSynth: MRI Physics for Pan-Contrast AI

Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling

Generalizable synthetic MRI with physics-informed convolutional networks

Image synthesis in contrast MRI based on super resolution reconstruction with multi-refinement cycle-consistent generative adversarial networks

McCaD: Multi-Contrast MRI Conditioned, Adaptive Adversarial Diffusion Model for High-Fidelity MRI Synthesis

Single-subject Multi-contrast MRI Super-resolution via Implicit Neural Representations

Generalizable Synthetic Multi-Contrast MRI Generation Using Physics-Informed Convolutional Networks

Synthesize High-Quality Multi-Contrast Magnetic Resonance Imaging from Multi-Echo Acquisition Using Multi-Task Deep Generative Model

SynthSR: A public AI tool to turn heterogeneous clinical brain scans into high-resolution T1-weighted images for 3D morphometry

Learning to Synthesize 7 T MRI from 3 T MRI with Few Data by Deformable Augmentation.

Contrast Agents of Magnetic Resonance Imaging and Future Perspective

Deep learning-based 3D MRI contrast-enhanced synthesis from a 2D noncontrast T2Flair sequence

Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network

One for Multiple: Physics-informed Synthetic Data Boosts Generalizable Deep Learning for Fast MRI Reconstruction

Dynamic and Rapid Deep Synthesis of Molecular MRI Signals

Synthesized 7T MPRAGE From 3T MPRAGE Using Generative Adversarial Network and Validation in Clinical Brain Imaging: A Feasibility Study

Deep learning based MRI contrast synthesis using full volume prediction using full volume prediction

PTNet: A High-Resolution Infant MRI Synthesizer Based on Transformer

Synthesizing MR Image Contrast Enhancement Using 3D High-Resolution ConvNets

A paired dataset of T1- and T2-weighted MRI at 3 Tesla and 7 Tesla

Enhanced Magnetic Resonance Image Synthesis with Contrast-Aware Generative Adversarial Networks