Abstract:The human brain can be modeled as multiple interrelated shapes (or a multishape), each for characterizing one aspect of the brain, such as the cortex and white matter pathways. Predicting the developing multishape is a very challenging task due to the contrasting nature of the developmental trajectories of the constituent shapes: smooth for the cortical surface and non-smooth for white matter tracts due to changes such as bifurcation. We recently addressed this problem and proposed an approach for predicting the multishape developmental spatiotemporal trajectories of infant brains based only on neonatal MRI data using a set of geometric, dynamic, and fiber-to-surface connectivity features. In this paper, we propose two key innovations to further improve the prediction of multishape evolution. First, for a more accurate cortical surface prediction, instead of simply relying on one neonatal atlas to guide the prediction of the multishape, we propose to use multiple neonatal atlases to build a spatially heterogeneous atlas using the multidirectional varifold representation. This individualizes the atlas by locally maximizing its similarity to the testing baseline cortical shape for each cortical region, thereby better representing the baseline testing cortical surface, which founds the multishape prediction process. Second, for temporally consistent fiber prediction, we propose to reliably estimate spatiotemporal connectivity features using low-rank tensor completion, thereby capturing the variability and richness of the temporal development of fibers. Experimental results confirm that the proposed variants significantly improve the prediction performance of our original multishape prediction framework for both cortical surfaces and fiber tracts shape at 3, 6, and 9 months of age. Our pioneering model will pave the way for learning how to predict the evolution of anatomical shapes with abnormal changes. Ultimately, devising accurate shape evolution prediction models that can help quantify and predict the severity of a brain disorder as it progresses will be of great aid in individualized treatment planning.

SurfGNN: A robust surface-based prediction model with interpretability for coactivation maps of spatial and cortical features

Regional Brain Fusion: Graph Convolutional Network for Alzheimer's Disease Prediction and Analysis

Joint Prediction of Longitudinal Development of Cortical Surfaces and White Matter Fibers from Neonatal MRI

A Hybrid Multishape Learning Framework for Longitudinal Prediction of Cortical Surfaces and Fiber Tracts Using Neonatal Data

Deep Modeling of Growth Trajectories for Longitudinal Prediction of Missing Infant Cortical Surfaces

Prediction of Infant Cognitive Development with Cortical Surface-Based Multimodal Learning

SurfNN: Joint Reconstruction of Multiple Cortical Surfaces from Magnetic Resonance Images

Identification of Novel Cortical Surface Biomarkers for Predicting Cognitive Outcomes Based on Group-Level` 2,1 Norm

A Deep Generative Model of Neonatal Cortical Surface Development

Brain Connectivity Based Graph Convolutional Networks and Its Application to Infant Age Prediction

BrainGNN: Interpretable Brain Graph Neural Network for fMRI Analysis

Graph Neural Networks for Surfactant Multi-Property Prediction

Brain Age Prediction Using Multi-Hop Graph Attention Combined with Convolutional Neural Network

SurfFlow: A Flow-Based Approach for Rapid and Accurate Cortical Surface Reconstruction from Infant Brain MRI

GESH-Net: Graph-Enhanced Spherical Harmonic Convolutional Networks for Cortical Surface Registration

Signed Curvature Graph Representation Learning of Brain Networks for Brain Age Estimation

Cortical Surface Diffusion Generative Models

A Novel Prediction of High-Risk Schizophrenia in Neonates Using Reconstructed Surface and Local Structure in MR Image

Prediction of cognitive scores by movie-watching fmri connectivity and eye movement via spectral graph convolutions

Learning Infant Brain Developmental Connectivity for Cognitive Score Prediction.

Neural Surfel Reconstruction: Addressing Loop Closure Challenges in Large-Scale 3D Neural Scene Mapping