Abstract:PURPOSE: The existence of multicontrast magnetic resonance (MR) images increases the level of clinical information available for the diagnosis and treatment of brain cancer patients. However, acquiring the complete set of multicontrast MR images is not always practically feasible. In this study, we developed a state-of-the-art deep learning convolutional neural network (CNN) for image-to-image translation across three standards MRI contrasts for the brain.METHODS: BRATS'2018 MRI dataset of 477 patients clinically diagnosed with glioma brain cancer was used in this study, with each patient having T1-weighted (T1), T2-weighted (T2), and FLAIR contrasts. It was randomly split into 64%, 16%, and 20% as training, validation, and test set, respectively. We developed a U-Net model to learn the nonlinear mapping of a source image contrast to a target image contrast across three MRI contrasts. The model was trained and validated with 2D paired MR images using a mean-squared error (MSE) cost function, Adam optimizer with 0.001 learning rate, and 120 epochs with a batch size of 32. The generated synthetic-MR images were evaluated against the ground-truth images by computing the MSE, mean absolute error (MAE), peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM).RESULTS: The generated synthetic-MR images with our model were nearly indistinguishable from the real images on the testing dataset for all translations, except synthetic FLAIR images had slightly lower quality and exhibited loss of details. The range of average PSNR, MSE, MAE, and SSIM values over the six translations were 29.44-33.25 dB, 0.0005-0.0012, 0.0086-0.0149, and 0.932-0.946, respectively. Our results were as good as the best-reported results by other deep learning models on BRATS datasets.CONCLUSIONS: Our U-Net model exhibited that it can accurately perform image-to-image translation across brain MRI contrasts. It could hold great promise for clinical use for improved clinical decision-making and better diagnosis of brain cancer patients due to the availability of multicontrast MRIs. This approach may be clinically relevant and setting a significant step to efficiently fill a gap of absent MR sequences without additional scanning.

Generalizable Synthetic Multi-Contrast MRI Generation Using Physics-Informed Convolutional Networks

Generalizable synthetic MRI with physics-informed convolutional networks

A Novel Method Of Synthetic Ct Generation From Mr Images Based On Convolutional Neural Networks

Synthesize High-Quality Multi-Contrast Magnetic Resonance Imaging from Multi-Echo Acquisition Using Multi-Task Deep Generative Model

Deep learning based MRI contrast synthesis using full volume prediction using full volume prediction

Unpaired Multi-contrast MR Image Synthesis Using Generative Adversarial Networks.

Physics-Informed Latent Diffusion for Multimodal Brain MRI Synthesis

Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networks

Image synthesis in contrast MRI based on super resolution reconstruction with multi-refinement cycle-consistent generative adversarial networks

UltimateSynth: MRI Physics for Pan-Contrast AI

Multi-contrast high-field quality image synthesis for portable low-field MRI using generative adversarial networks and paired data

Deep learning‐based convolutional neural network for intramodality brain MRI synthesis

Bidirectional feature matching based on deep pairwise contrastive learning for multiparametric MRI image synthesis

Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network

MR-Contrast-Aware Image-to-Image Translations with Generative Adversarial Networks

One for Multiple: Physics-informed Synthetic Data Boosts Generalizable Deep Learning for Fast MRI Reconstruction

Synthesizing MR Image Contrast Enhancement Using 3D High-Resolution ConvNets

Synergistic Reconstruction and Synthesis via Generative Adversarial Networks for Accelerated Multi-Contrast MRI

Build-A-FLAIR: Synthetic T2-FLAIR Contrast Generation through Physics Informed Deep Learning

Deep learning-based 3D MRI contrast-enhanced synthesis from a 2D noncontrast T2Flair sequence

A Deep Learning Model for Multi-Domain MRI Synthesis Using Generative Adversarial Networks