Abstract:Site differences, or systematic differences in feature distributions across multiple data-acquisition sites, are a known source of heterogeneity that may adversely affect large-scale meta- and mega-analyses of independently collected neuroimaging data. They influence nearly all multi-site imaging modalities and biomarkers, and methods to compensate for them can improve reliability and generalizability in the analysis of genetics, omics, and clinical data. The origins of statistical site effects are complex and involve both technical differences (scanner vendor, head coil, acquisition parameters, imaging processing) and differences in sample characteristics (inclusion/exclusion criteria, sample size, ancestry) between sites. In an age of expanding international consortium research, there is a growing need to disentangle technical site effects from sample characteristics of interest. Numerous statistical and machine learning methods have been developed to control for, model, or attenuate site effects – yet to date, no comprehensive review has discussed the benefits and drawbacks of each for different use cases. Here, we provide an overview of the different existing statistical and machine learning methods developed to remove unwanted site effects from independently collected neuroimaging samples. We focus on linear mixed effect models, the ComBat technique and its variants, adjustments based on image quality metrics, normative modeling, and deep learning approaches such as generative adversarial networks. For each method, we outline the statistical foundation and summarize strengths and weaknesses, including their assumptions and conditions of use. We provide information on software availability and comment on the ease of use and the applicability of these methods to different types of data. We discuss validation and comparative reports, mention caveats and provide guidance on when to use each method, depending on context and specific research questions.

Hierarchical Bayesian Regression for Multi-Site Normative Modeling of Neuroimaging Data

Non-Gaussian Normative Modelling With Hierarchical Bayesian Regression

Scalable Multi-Task Gaussian Process Tensor Regression for Normative Modeling of Structured Variation in Neuroimaging Data

Multi-modal Variational Autoencoders for normative modelling across multiple imaging modalities

Hierarchical Bayesian modeling of multi-region brain cell count data

Brain Morphology Normative modelling platform for abnormality and Centile estimation: Brain MoNoCle

Estimating cortical thickness trajectories in children across different scanners using transfer learning from normative models

Normative Modeling using Multimodal Variational Autoencoders to Identify Abnormal Brain Structural Patterns in Alzheimer Disease

Analyzing heterogeneity in Alzheimer Disease using multimodal normative modeling on imaging-based ATN biomarkers

Learning Bayesian Network Structure Based on the Classification and Regression Tree

Site effects how-to and when: An overview of retrospective techniques to accommodate site effects in multi-site neuroimaging analyses

Predicting Brain Activity Using a Bayesian Spatial Model.

A generalizable normative deep autoencoder for brain morphological anomaly detection: application to the multi-site StratiBip dataset on bipolar disorder in an external validation framework

Dynamic Bayesian Network Modeling for Longitudinal Brain Morphometry

A Bayesian spatial model for imaging genetics

Learning Robust Hierarchical Patterns of Human Brain across Many fMRI Studies

Normative modelling of brain morphometry across the lifespan with CentileBrain: algorithm benchmarking and model optimisation

Normative Modeling of Brain Morphometry Across the Lifespan Using CentileBrain: Algorithm Benchmarking and Model Optimization

Spatially informed Bayesian neural network for neurodegenerative diseases classification

High-dimensional single-index Bayesian modeling of brain atrophy

Classification of Multi-Site MR Images in the Presence of Heterogeneity Using Multi-Task Learning