Abstract:We develop a novel harmonization approach for T1‐weighted magnetic resonance imaging using a style‐encoding generative adversarial network that can be used to harmonize entire images for a variety of international, multi‐cohort, neuroimaging collaborations. Results demonstrated that this model avoids the need to control for clinical or demographic information. We showed that our harmonization removed the cross‐site variances, while preserving the anatomical information and clinical meaningful patterns. Recent work within neuroimaging consortia have aimed to identify reproducible, and often subtle, brain signatures of psychiatric or neurological conditions. To allow for high‐powered brain imaging analyses, it is often necessary to pool MR images that were acquired with different protocols across multiple scanners. Current retrospective harmonization techniques have shown promise in removing site‐related image variation. However, most statistical approaches may over‐correct for technical, scanning‐related, variation as they cannot distinguish between confounded image‐acquisition based variability and site‐related population variability. Such statistical methods often require that datasets contain subjects or patient groups with similar clinical or demographic information to isolate the acquisition‐based variability. To overcome this limitation, we consider site‐related magnetic resonance (MR) imaging harmonization as a style transfer problem rather than a domain transfer problem. Using a fully unsupervised deep‐learning framework based on a generative adversarial network (GAN), we show that MR images can be harmonized by inserting the style information encoded from a single reference image, without knowing their site/scanner labels a priori. We trained our model using data from five large‐scale multisite datasets with varied demographics. Results demonstrated that our style‐encoding model can harmonize MR images, and match intensity profiles, without relying on traveling subjects. This model also avoids the need to control for clinical, diagnostic, or demographic information. We highlight the effectiveness of our method for clinical research by comparing extracted cortical and subcortical features, brain‐age estimates, and case–control effect sizes before and after the harmonization. We showed that our harmonization removed the site‐related variances, while preserving the anatomical information and clinical meaningful patterns. We further demonstrated that with a diverse training set, our method successfully harmonized MR images collected from unseen scanners and protocols, suggesting a promising tool for ongoing collaborative studies. Source code is released in USC‐IGC/style_transfer_harmonization (github.com).

IGUANe: a 3D generalizable CycleGAN for multicenter harmonization of brain MR images

ImUnity: a generalizable VAE-GAN solution for multicenter MR image harmonization

Segmentation-Renormalized Deep Feature Modulation for Unpaired Image Harmonization

Harmonization Across Imaging Locations(HAIL): One-Shot Learning for Brain MRI

Style transfer generative adversarial networks to harmonize multisite MRI to a single reference image to avoid overcorrection

MRI-Trans-GAN: 3D MRI Cross-Modality Translation

Diffusion based multi-domain neuroimaging harmonization method with preservation of anatomical details

ReeGAN: MRI image edge-preserving synthesis based on GANs trained with misaligned data

MRI to PET Cross-Modality Translation using Globally and Locally Aware GAN (GLA-GAN) for Multi-Modal Diagnosis of Alzheimer's Disease

Unsupervised Domain Adaptation via CycleGAN for White Matter Hyperintensity Segmentation in Multicenter MR Images

Multi-modality MRI Arbitrary Transformation Using Unified Generative Adversarial Networks

Normalization of breast MRIs using cycle-consistent generative adversarial networks

MCMT-GAN: Multi-Task Coherent Modality Transferable GAN for 3D Brain Image Synthesis.

CycleGAN Models for MRI Image Translation

Memory-efficient GAN-based domain translation of high resolution 3D medical images

Multi-Texture GAN: Exploring the Multi-Scale Texture Translation for Brain MR Images

Cross-modality image translation of 3 Tesla Magnetic Resonance Imaging to 7 Tesla using Generative Adversarial Networks

Harmonized neonatal brain MR image segmentation model for cross-site datasets

Cross-Modality Augmentation Of Brain Mr Images Using A Novel Pairwise Generative Adversarial Network For Enhanced Glioma Classification

A Deep Learning Harmonization of Multi-Vendor MRI for Robust Intervertebral Disc Segmentation

Transfer learning enhanced generative adversarial networks for multi-channel MRI reconstruction