Abstract:PURPOSE: The existence of multicontrast magnetic resonance (MR) images increases the level of clinical information available for the diagnosis and treatment of brain cancer patients. However, acquiring the complete set of multicontrast MR images is not always practically feasible. In this study, we developed a state-of-the-art deep learning convolutional neural network (CNN) for image-to-image translation across three standards MRI contrasts for the brain.METHODS: BRATS'2018 MRI dataset of 477 patients clinically diagnosed with glioma brain cancer was used in this study, with each patient having T1-weighted (T1), T2-weighted (T2), and FLAIR contrasts. It was randomly split into 64%, 16%, and 20% as training, validation, and test set, respectively. We developed a U-Net model to learn the nonlinear mapping of a source image contrast to a target image contrast across three MRI contrasts. The model was trained and validated with 2D paired MR images using a mean-squared error (MSE) cost function, Adam optimizer with 0.001 learning rate, and 120 epochs with a batch size of 32. The generated synthetic-MR images were evaluated against the ground-truth images by computing the MSE, mean absolute error (MAE), peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM).RESULTS: The generated synthetic-MR images with our model were nearly indistinguishable from the real images on the testing dataset for all translations, except synthetic FLAIR images had slightly lower quality and exhibited loss of details. The range of average PSNR, MSE, MAE, and SSIM values over the six translations were 29.44-33.25 dB, 0.0005-0.0012, 0.0086-0.0149, and 0.932-0.946, respectively. Our results were as good as the best-reported results by other deep learning models on BRATS datasets.CONCLUSIONS: Our U-Net model exhibited that it can accurately perform image-to-image translation across brain MRI contrasts. It could hold great promise for clinical use for improved clinical decision-making and better diagnosis of brain cancer patients due to the availability of multicontrast MRIs. This approach may be clinically relevant and setting a significant step to efficiently fill a gap of absent MR sequences without additional scanning.

Generalizable synthetic MRI with physics-informed convolutional networks

Generalizable Synthetic Multi-Contrast MRI Generation Using Physics-Informed Convolutional Networks

Deep learning based MRI contrast synthesis using full volume prediction using full volume prediction

Physics-Informed Latent Diffusion for Multimodal Brain MRI Synthesis

UltimateSynth: MRI Physics for Pan-Contrast AI

PILOT: Physics-Informed Learned Optimized Trajectories for Accelerated MRI

Synthesize High-Quality Multi-Contrast Magnetic Resonance Imaging from Multi-Echo Acquisition Using Multi-Task Deep Generative Model

Synthesized 7T MPRAGE From 3T MPRAGE Using Generative Adversarial Network and Validation in Clinical Brain Imaging: A Feasibility Study

Unsupervised learning of MRI tissue properties using MRI physics models

Multi-contrast high-field quality image synthesis for portable low-field MRI using generative adversarial networks and paired data

Multi-Parameter Molecular MRI Quantification using Physics-Informed Self-Supervised Learning

Image synthesis in contrast MRI based on super resolution reconstruction with multi-refinement cycle-consistent generative adversarial networks

Deep learning‐based convolutional neural network for intramodality brain MRI synthesis

One for Multiple: Physics-informed Synthetic Data Boosts Generalizable Deep Learning for Fast MRI Reconstruction

Exploring contrast generalisation in deep learning-based brain MRI-to-CT synthesis

Deep learning-based 3D MRI contrast-enhanced synthesis from a 2D noncontrast T2Flair sequence

A Physics-based Generative Model to Synthesize Training Datasets for MRI-based Fat Quantification

MR-Contrast-Aware Image-to-Image Translations with Generative Adversarial Networks

Dynamic and Rapid Deep Synthesis of Molecular MRI Signals

Artificial T1-Weighted Postcontrast Brain MRI: A Deep Learning Method for Contrast Signal Extraction

Unpaired Multi-contrast MR Image Synthesis Using Generative Adversarial Networks.