Abstract:Magnetic resonance imaging (MRI) technique can generate various tissue contrasts by using different pulse sequences and parameters. However, obtaining multiple different contrast images for the same patient is sometimes time-consuming and costly. In this paper, we propose a novel generative adversarial network based on decoupled dual feature representations (D2FE-GAN) for cross-modality MRI synthesis. Inspired by the previous works of image style transferring, we argue that the MRI images can be viewed as a compound of underlying information shared among the bodies of modalities (e.g., semantic information), and representative information varying with the styles of modalities (e.g., edges, contrasts). Different from the existing GAN-based methods that pay attention to either the body consistency or the style refinement, the proposed D2FE-GAN method considers both aspects for better synthesis. Specifically, our method decouples the underlying information and the representative information from the source modality and target modality, respectively, through two dissimilar encoders. In response to the invisibility of target modality in testing phase, we propose to employ a Residual Network firstly to generate an intermediate modality as the pseudo target modality. Subsequently, the decoupled two kinds of information will be integrated through a decoder. Here, we introduce the Adaptive Instance Normalization layer, in which the affine parameters are replaced by the mean and standard deviation of the representative information, thus completing the fusion processing of feature space information. Experimental results on BRATS2015 dataset and IXI dataset show that the proposed method outperforms the state-of-the-art image synthesis approaches in both qualitative and quantitative measures.

Conditional Generation of Medical Images via Disentangled Adversarial Inference.

IRLSG: Invariant Representation Learning for Single-Domain Generalization in Medical Image Segmentation

DiRA: Discriminative, Restorative, and Adversarial Learning for Self-supervised Medical Image Analysis

CDDSA: Contrastive domain disentanglement and style augmentation for generalizable medical image segmentation

Disentangling Factors of Variation in Deep Representations Using Adversarial Training.

Self-supervised learning for medical image analysis: Discriminative, restorative, or adversarial?

D2FE-GAN: Decoupled dual feature extraction based GAN for MRI image synthesis

Synthetic Medical Images from Dual Generative Adversarial Networks

Hierarchical medical image report adversarial generation with hybrid discriminator

Conditional generative learning for medical image imputation

Med-cDiff: Conditional Medical Image Generation with Diffusion Models

DR-GAN: Conditional Generative Adversarial Network for Fine-Grained Lesion Synthesis on Diabetic Retinopathy Images

Diffusion-based Visual Representation Learning for Medical Question Answering.

Disentangling representations of retinal images with generative models

Learning Robust Representation for Joint Grading of Ophthalmic Diseases via Adaptive Curriculum and Feature Disentanglement

DAug: Diffusion-based Channel Augmentation for Radiology Image Retrieval and Classification

Invariant Content Representation for Generalizable Medical Image Segmentation

GH-DDM: the generalized hybrid denoising diffusion model for medical image generation

Counterfactual MRI Data Augmentation using Conditional Denoising Diffusion Generative Models

Controllable retinal image synthesis using conditional StyleGAN and latent space manipulation for improved diagnosis and grading of diabetic retinopathy

Applying Conditional Generative Adversarial Networks for Imaging Diagnosis