Abstract:The human brain can be modeled as multiple interrelated shapes (or a multishape), each for characterizing one aspect of the brain, such as the cortex and white matter pathways. Predicting the developing multishape is a very challenging task due to the contrasting nature of the developmental trajectories of the constituent shapes: smooth for the cortical surface and non-smooth for white matter tracts due to changes such as bifurcation. We recently addressed this problem and proposed an approach for predicting the multishape developmental spatiotemporal trajectories of infant brains based only on neonatal MRI data using a set of geometric, dynamic, and fiber-to-surface connectivity features. In this paper, we propose two key innovations to further improve the prediction of multishape evolution. First, for a more accurate cortical surface prediction, instead of simply relying on one neonatal atlas to guide the prediction of the multishape, we propose to use multiple neonatal atlases to build a spatially heterogeneous atlas using the multidirectional varifold representation. This individualizes the atlas by locally maximizing its similarity to the testing baseline cortical shape for each cortical region, thereby better representing the baseline testing cortical surface, which founds the multishape prediction process. Second, for temporally consistent fiber prediction, we propose to reliably estimate spatiotemporal connectivity features using low-rank tensor completion, thereby capturing the variability and richness of the temporal development of fibers. Experimental results confirm that the proposed variants significantly improve the prediction performance of our original multishape prediction framework for both cortical surfaces and fiber tracts shape at 3, 6, and 9 months of age. Our pioneering model will pave the way for learning how to predict the evolution of anatomical shapes with abnormal changes. Ultimately, devising accurate shape evolution prediction models that can help quantify and predict the severity of a brain disorder as it progresses will be of great aid in individualized treatment planning.

Deep Multimodal Learning From MRI and Clinical Data for Early Prediction of Neurodevelopmental Deficits in Very Preterm Infants

A Multi-Task, Multi-Stage Deep Transfer Learning Model for Early Prediction of Neurodevelopment in Very Preterm Infants

Multi-modal Perceptual Adversarial Learning for Longitudinal Prediction of Infant MR Images

Machine-learning based prediction of future outcome using multimodal MRI during early childhood

Predicting 2-year neurodevelopmental outcomes in preterm infants using multimodal structural brain magnetic resonance imaging with local connectivity

Early Prediction of Cognitive Deficit in Very Preterm Infants Using Brain Structural Connectome with Transfer Learning Enhanced Deep Convolutional Neural Networks.

Joint Prediction of Longitudinal Development of Cortical Surfaces and White Matter Fibers from Neonatal MRI

Joint Self-Supervised and Supervised Contrastive Learning for Multimodal MRI Data: Towards Predicting Abnormal Neurodevelopment

Predicting neurodevelopmental outcomes in extremely preterm neonates with low-grade germinal matrix-intraventricular hemorrhage using synthetic MRI

Transformer based multi-modal MRI fusion for prediction of post-menstrual age and neonatal brain development analysis

Development-driven Diffusion Model for Longitudinal Prediction of Fetal Brain MRI with Unpaired Data

A Deep Learning-Based Brain Age Prediction Model for Preterm Infants Via Neonatal MRI

A Novel Ontology-guided Attribute Partitioning Ensemble Learning Model for Early Prediction of Cognitive Deficits using Quantitative Structural MRI in Very Preterm Infants

Automated Neuroprognostication via Machine Learning in Neonates with Hypoxic-Ischemic Encephalopathy

Brain Age Prediction in Developing Childhood with Multimodal Magnetic Resonance Images.

Deep learning to optimize MRI prediction of motor outcomes after HIE

Automatic Segmentation of Diffuse White Matter Abnormality on T2-weighted Brain MR Images Using Deep Learning in Very Preterm Infants

The Association between Ventricle Ratio in Preterm Infants and Motor Developmental Delay

Quantitative Magnetic Resonance Imaging for Neurodevelopmental Outcome Prediction in Neonates Born Extremely Premature—An Exploratory Study

Supervised Contrastive Learning Enhances Graph Convolutional Networks for Predicting Neurodevelopmental Deficits in Very Preterm Infants using Brain Structural Connectome

Predicting Individualized Clinical Measures by a Generalized Prediction Framework and Multimodal Fusion of MRI Data.