Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Objective</h3><p>This work aims to synthesize a real-like missing MRI modality using multiple modalities those already obtained, thus providing more abundant diagnostic information, and promoting the improvement of some downstream tasks, such as segmentation and diagnosis.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Methods</h3><p>With an adversarial network modelling the nonlinear mapping between the inputs and the output, our proposed LR-cGAN extracts the inherent latent representations from different MRI modalities with N collaboratively trained encoders, and fuses them by a latent space processing network (LSPN) composed of several residual blocks. Apart from L1 loss, the image gradient difference loss (GDL) is considered additionally as the objective function to alleviate the problem of insufficient image sharpening. To validate the effectiveness of LR-cGAN, corresponding experiments were evaluated by peak SNR (PSNR), structural similarity index (SSIM) and normalized root-mean-square error (NRMSE) on BRATS 2015 dataset.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>Compared to single-modality input, two-modality input improves the synthesis results by 1.196 dB PSNR, 0.019 SSIM and 0.04 NRMSE. With more inputs added, the synthesis performance exhibits an increasing trend. Once any key component, that is, LSPN, GDL loss or adversarial loss, is removed, the quality of the results will reduce to a lower level, proving their contributions to our model. Meanwhile, the final performance of our LR-cGAN network outperforms REPLICA, M-GAN, MILR and sGAN in all metrics on different synthesis tasks, demonstrating its superiority.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion</h3><p>Our proposed LR-cGAN has the flexible ability of receiving multiple modalities and generating realistic images compared to real modality images, having the potential to supplement diagnostic information in clinical.</p>

HybridGAN: Hybrid Generative Adversarial Networks for MR Image Synthesis

Multimodal MR Image Synthesis Using Gradient Prior and Adversarial Learning

Synthesizing Multi-Contrast MR Images Via Novel 3D Conditional Variational Auto-Encoding GAN

ReeGAN: MRI image edge-preserving synthesis based on GANs trained with misaligned data

Unpaired Multi-contrast MR Image Synthesis Using Generative Adversarial Networks.

Hybrid Generative Adversarial Networks for Deep MR to CT Synthesis Using Unpaired Data

DiamondGAN: Unified Multi-Modal Generative Adversarial Networks for MRI Sequences Synthesis

Enhanced Magnetic Resonance Image Synthesis with Contrast-Aware Generative Adversarial Networks

Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Data

Multi-Modal MRI Image Synthesis via GAN With Multi-Scale Gate Mergence

Generative Adversarial Training for MRA Image Synthesis Using Multi-Contrast MRI

LR-cGAN: Latent representation based conditional generative adversarial network for multi-modality MRI synthesis

A Deep Learning Model for Multi-Domain MRI Synthesis Using Generative Adversarial Networks

High-resolution medical image synthesis using progressively grown generative adversarial networks

HARA-GAN: Hybrid Attention and Relative Average Discriminator Based Generative Adversarial Network for MR Image Reconstruction

Synthetic Brain Images: Bridging the Gap in Brain Mapping With Generative Adversarial Model

Image synthesis in contrast MRI based on super resolution reconstruction with multi-refinement cycle-consistent generative adversarial networks

Mask-guided generative adversarial network for MRI-based CT synthesis

mustGAN: Multi-Stream Generative Adversarial Networks for MR Image Synthesis

SkrGAN: Sketching-rendering Unconditional Generative Adversarial Networks for Medical Image Synthesis

D2FE-GAN: Decoupled dual feature extraction based GAN for MRI image synthesis