Abstract:Generative adversarial network (GAN) has been widely explored for cross-modality medical image synthesis. The existing GAN models usually adversarially learn a global sample space mapping from the source-modality to the target-modality and then indiscriminately apply this mapping to all samples in the whole space for prediction. However, due to the scarcity of training samples in contrast to the complicated nature of medical image synthesis, learning a single global sample space mapping that is “optimal” to all samples is very challenging, if not intractable. To address this issue, this paper proposes sample-adaptive GAN models, which not only cater for the global sample space mapping between the source- and the target-modalities but also explore the local space around each given sample to extract its unique characteristic. Specifically, the proposed sample-adaptive GANs decompose the entire learning model into two cooperative paths. The baseline path learns a common GAN model by fitting all the training samples as usual for the global sample space mapping. The new sample-adaptive path additionally models each sample by learning its relationship with its neighboring training samples and using the target-modality features of these training samples as auxiliary information for synthesis. Enhanced by this sample-adaptive path, the proposed sample-adaptive GANs are able to flexibly adjust themselves to different samples, and therefore optimize the synthesis performance. Our models have been verified on three cross-modality MR image synthesis tasks from two public datasets, and they significantly outperform the state-of-the-art methods in comparison. Moreover, the experiment also indicates that our sample-adaptive strategy could be utilized to improve various backbone GAN models. It complements the existing GANs models and can be readily integrated when needed.

FedMed-GAN: Federated Domain Translation on Unsupervised Cross-Modality Brain Image Synthesis

FedMed-ATL: Misaligned Unpaired Cross-Modality Neuroimage Synthesis Via Affine Transform Loss

FedMed-ATL: Misaligned Unpaired Brain Image Synthesis via Affine Transform Loss

Gradient Matching Federated Domain Adaptation for Brain Image Classification.

MedGAN: Medical Image Translation using GANs

Multi-Constraint Transferable Generative Adversarial Networks for Cross-Modal Brain Image Synthesis

MCMT-GAN: Multi-Task Coherent Modality Transferable GAN for 3D Brain Image Synthesis.

MedGAN: An adaptive GAN approach for medical image generation

Brain MR to PET Synthesis via Bidirectional Generative Adversarial Network

Improving Multi-Center Generalizability of GAN-Based Fat Suppression using Federated Learning

ISGAN: Unsupervised Domain Adaptation with Improved Symmetric GAN for Cross-Modality Multi-organ Segmentation

D2FE-GAN: Decoupled dual feature extraction based GAN for MRI image synthesis

MRI to PET Cross-Modality Translation using Globally and Locally Aware GAN (GLA-GAN) for Multi-Modal Diagnosis of Alzheimer's Disease

Federated Edge Learning for Medical Image Augmentation

Data-Enabled Intelligence in Complex Industrial Systems Cross-Model Transformer Method for Medical Image Synthesis

Sample-adaptive GANs: Linking Global and Local Mappings for Cross-modality MR Image Synthesis.

Cross-Model Transformer Method for Medical Image Synthesis

The Domain Shift Problem of Medical Image Segmentation and Vendor-Adaptation by Unet-GAN

AutoEncoder-Driven Multimodal Collaborative Learning for Medical Image Synthesis

Memory-efficient GAN-based domain translation of high resolution 3D medical images

Fedsemgan: A Semi-Supervised Federated Learning-Based Edge-Cloud Collaborative Framework for Medical Diagnosis Service