Abstract:We examined the out‐of‐sample predictions of previously developed brain age models, which were chosen based on the size and diversity of their training data. Broadly speaking, no single model was uniformly better across all test samples or facets of generalizability. The largest limitations affecting generalizability were scanner‐related variance and biased brain age predictions. Machine learning has been increasingly applied to neuroimaging data to predict age, deriving a personalized biomarker with potential clinical applications. The scientific and clinical value of these models depends on their applicability to independently acquired scans from diverse sources. Accordingly, we evaluated the generalizability of two brain age models that were trained across the lifespan by applying them to three distinct early‐life samples with participants aged 8–22 years. These models were chosen based on the size and diversity of their training data, but they also differed greatly in their processing methods and predictive algorithms. Specifically, one brain age model was built by applying gradient tree boosting (GTB) to extracted features of cortical thickness, surface area, and brain volume. The other model applied a 2D convolutional neural network (DBN) to minimally preprocessed slices of T1‐weighted scans. Additional model variants were created to understand how generalizability changed when each model was trained with data that became more similar to the test samples in terms of age and acquisition protocols. Our results illustrated numerous trade‐offs. The GTB predictions were relatively more accurate overall and yielded more reliable predictions when applied to lower quality scans. In contrast, the DBN displayed the most utility in detecting associations between brain age gaps and cognitive functioning. Broadly speaking, the largest limitations affecting generalizability were acquisition protocol differences and biased brain age estimates. If such confounds could eventually be removed without post‐hoc corrections, brain age predictions may have greater utility as personalized biomarkers of healthy aging.

Estimating cortical thickness trajectories in children across different scanners using transfer learning from normative models

Growth charts for individualized evaluation of brain morphometry for preschool children

Joint Prediction of Longitudinal Development of Cortical Surfaces and White Matter Fibers from Neonatal MRI

Using normative models pre-trained on cross-sectional data to evaluate intra-individual longitudinal changes in neuroimaging data

Normative models combining fetal and postnatal MRI data to characterize neurodevelopmental trajectories during the transition from in- to ex-utero

Normative modelling of brain morphometry across the lifespan with CentileBrain: algorithm benchmarking and model optimisation

Lifespan Normative Modeling of Brain Microstructure

Generalizability of Normative Models of Brain Morphometry Across Distinct Ethnoracial Groups

Neurocranium thickness mapping in early childhood.

A Hybrid Multishape Learning Framework for Longitudinal Prediction of Cortical Surfaces and Fiber Tracts Using Neonatal Data

Hierarchical Bayesian Regression for Multi-Site Normative Modeling of Neuroimaging Data

Phenotyping the Preterm Brain: Characterizing Individual Deviations From Normative Volumetric Development in Two Large Infant Cohorts

Normative models reveal distinct cortical abnormalities to dimensions of psychopathologies in preadolescents

Learning lifespan brain anatomical correspondence via cortical developmental continuity transfer

Biological Brain Age Prediction Using Cortical Thickness Data: A Large Scale Cohort Study

Synthesizing longitudinal cortical thickness estimates with a flexible and hierarchical multivariate measurement-error model

Normative Modeling of Brain Morphometry Across the Lifespan Using CentileBrain: Algorithm Benchmarking and Model Optimization

Benchmarking the generalizability of brain age models: Challenges posed by scanner variance and prediction bias

Brain Morphology Normative modelling platform for abnormality and Centile estimation: Brain MoNoCle

Multiscale cortical morphometry reveals pronounced regional and scale-dependent variations across the lifespan

Optimising brain age estimation through transfer learning: A suite of pre‐trained foundation models for improved performance and generalisability in a clinical setting