Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Objective</h3><p>This work aims to synthesize a real-like missing MRI modality using multiple modalities those already obtained, thus providing more abundant diagnostic information, and promoting the improvement of some downstream tasks, such as segmentation and diagnosis.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Methods</h3><p>With an adversarial network modelling the nonlinear mapping between the inputs and the output, our proposed LR-cGAN extracts the inherent latent representations from different MRI modalities with N collaboratively trained encoders, and fuses them by a latent space processing network (LSPN) composed of several residual blocks. Apart from L1 loss, the image gradient difference loss (GDL) is considered additionally as the objective function to alleviate the problem of insufficient image sharpening. To validate the effectiveness of LR-cGAN, corresponding experiments were evaluated by peak SNR (PSNR), structural similarity index (SSIM) and normalized root-mean-square error (NRMSE) on BRATS 2015 dataset.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>Compared to single-modality input, two-modality input improves the synthesis results by 1.196 dB PSNR, 0.019 SSIM and 0.04 NRMSE. With more inputs added, the synthesis performance exhibits an increasing trend. Once any key component, that is, LSPN, GDL loss or adversarial loss, is removed, the quality of the results will reduce to a lower level, proving their contributions to our model. Meanwhile, the final performance of our LR-cGAN network outperforms REPLICA, M-GAN, MILR and sGAN in all metrics on different synthesis tasks, demonstrating its superiority.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion</h3><p>Our proposed LR-cGAN has the flexible ability of receiving multiple modalities and generating realistic images compared to real modality images, having the potential to supplement diagnostic information in clinical.</p>

AutoEncoder-Driven Multimodal Collaborative Learning for Medical Image Synthesis

OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networks

Multimodal MR Image Synthesis Using Gradient Prior and Adversarial Learning

Unified Multi-Modal Image Synthesis for Missing Modality Imputation

An hetero-modal deep learning framework for medical image synthesis applied to contrast and non-contrast MRI

An Attentive-based Generative Model for Medical Image Synthesis

A layer-wise fusion network incorporating self-supervised learning for multimodal MR image synthesis

Multimodal image synthesis based on disentanglement representations of anatomical and modality specific features, learned using uncooperative relativistic GAN

FedMed-GAN: Federated Domain Translation on Unsupervised Cross-Modality Brain Image Synthesis

Multi-Constraint Transferable Generative Adversarial Networks for Cross-Modal Brain Image Synthesis

Label-informed cardiac magnetic resonance image synthesis through conditional generative adversarial networks

CMOS-GAN: Semi-Supervised Generative Adversarial Model for Cross-Modality Face Image Synthesis

Towards cross-modal organ translation and segmentation: A cycle- and shape-consistent generative adversarial network

LR-cGAN: Latent representation based conditional generative adversarial network for multi-modality MRI synthesis

Multi-Modal MRI Image Synthesis via GAN With Multi-Scale Gate Mergence

Deformation-aware GAN for Medical Image Synthesis with Substantially Misaligned Pairs

A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completion

Ea-GANs: Edge-aware Generative Adversarial Networks for Cross-modality MR Image Synthesis.

MedGAN: An adaptive GAN approach for medical image generation

Common feature learning for brain tumor MRI synthesis by context-aware generative adversarial network