Abstract:Introduction: MRI is one of the commonly used diagnostic methods in clinical practice, especially in brain diseases. There are many sequences in MRI, but T1CE images can only be obtained by using contrast agents. Many patients (such as cancer patients) must undergo alignment of multiple MRI sequences for diagnosis, especially the contrast-enhanced magnetic resonance sequence. However, some patients such as pregnant women, children, etc. find it difficult to use contrast agents to obtain enhanced sequences, and contrast agents have many adverse reactions, which can pose a significant risk. With the continuous development of deep learning, the emergence of generative adversarial networks makes it possible to extract features from one type of image to generate another type of image. Methods: We propose a generative adversarial network model with multimodal inputs and end-to-end decoding based on the pix2pix model. For the pix2pix model, we used four evaluation metrics: NMSE, RMSE, SSIM, and PNSR to assess the effectiveness of our generated model. Results: Through statistical analysis, we compared our proposed new model with pix2pix and found significant differences between the two. Our model outperformed pix2pix, with higher SSIM and PNSR, lower NMSE and RMSE. We also found that the input of T1W images and T2W images had better effects than other combinations, providing new ideas for subsequent work on generating magnetic resonance enhancement sequence images. By using our model, it is possible to generate magnetic resonance enhanced sequence images based on magnetic resonance non-enhanced sequence images. Discussion: This has significant implications as it can greatly reduce the use of contrast agents to protect populations such as pregnant women and children who are contraindicated for contrast agents. Additionally, contrast agents are relatively expensive, and this generation method may bring about substantial economic benefits.

MR-Contrast-Aware Image-to-Image Translations with Generative Adversarial Networks

Enhanced Magnetic Resonance Image Synthesis with Contrast-Aware Generative Adversarial Networks

Unpaired Multi-contrast MR Image Synthesis Using Generative Adversarial Networks.

A Novel Method Of Synthetic Ct Generation From Mr Images Based On Convolutional Neural Networks

Image synthesis in contrast MRI based on super resolution reconstruction with multi-refinement cycle-consistent generative adversarial networks

Contrast-enhanced MRI Synthesis from Non-Contrast MRI Using Attention CycleGAN

Assessing the importance of magnetic resonance contrasts using collaborative generative adversarial networks

Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networks

Synthesizing Multi-Contrast MR Images Via Novel 3D Conditional Variational Auto-Encoding GAN

Generative Adversarial Training for MRA Image Synthesis Using Multi-Contrast MRI

A Unified Hyper-GAN Model for Unpaired Multi-contrast MR Image Translation

Multi-modality MRI Arbitrary Transformation Using Unified Generative Adversarial Networks

Multimodal MR Image Synthesis Using Gradient Prior and Adversarial Learning

Multi-sequence generative adversarial network: better generation for enhanced magnetic resonance imaging images

Which Contrast Does Matter? Towards a Deep Understanding of MR Contrast using Collaborative GAN

MRI-Trans-GAN: 3D MRI Cross-Modality Translation

Cross-modality image translation of 3 Tesla Magnetic Resonance Imaging to 7 Tesla using Generative Adversarial Networks

Attention-Based Multi-Scale Generative Adversarial Network for synthesizing contrast-enhanced MRI

A least square generative network based on invariant contrastive feature pair learning for multimodal MR image synthesis

ReeGAN: MRI image edge-preserving synthesis based on GANs trained with misaligned data

Adaptive Gradient Balancing for Undersampled MRI Reconstruction and Image-to-Image Translation