A foundation model for generalized brain MRI analysis
Divyanshu Tak,Biniam Garomsa,Tafadzwa Chaunzwa,Anna Zapaishchykova,Juan Carlos Climent Pardo,Zezhong Ye,John Zielke,Yashwanth Ravipati,Sridhar Vajapeyam,Maryam Mahootiha,Ceilidh Smith,Ariana Familiar,Kevin Liu,Sanjay Prabhu,Pratiti Bandopadhayay,Ali Nabavizadeh,sabine mueller,Hugo Aerts,Raymond Huang,Tina Poussaint,Benjamin Harris Kann
DOI: https://doi.org/10.1101/2024.12.02.24317992
2024-12-03
Abstract:Artificial intelligence (AI) applied to brain magnetic resonance imaging (MRI) has the potential to improve disease diagnosis and management but requires algorithms with generalizable knowledge that can perform well in a variety of clinical scenarios. The field has been constrained, thus far, by limited training data and task-specific models that do not generalize well across patient populations and medical tasks. Foundation models, by leveraging self-supervised learning, pretraining, and targeted adaptation, present a promising paradigm to overcome these limitations. Here, we present Brain Imaging Adaptive Core (BrainIAC), a novel foundation model designed to learn generalized representations from unlabeled brain MRI data and serve as a core basis for diverse downstream application adaptation. Trained and validated on 48,519 brain MRIs across a broad spectrum of tasks, we demonstrate that BrainIAC outperforms localized supervised training and other pretrained models, particularly in low-data settings and high-difficulty tasks, allowing for application in scenarios otherwise infeasible. BrainIAC can be integrated into imaging pipelines and multimodal frameworks and may lead to improved biomarker discovery and AI clinical translation.