Abstract:The human brain can be modeled as multiple interrelated shapes (or a multishape), each for characterizing one aspect of the brain, such as the cortex and white matter pathways. Predicting the developing multishape is a very challenging task due to the contrasting nature of the developmental trajectories of the constituent shapes: smooth for the cortical surface and non-smooth for white matter tracts due to changes such as bifurcation. We recently addressed this problem and proposed an approach for predicting the multishape developmental spatiotemporal trajectories of infant brains based only on neonatal MRI data using a set of geometric, dynamic, and fiber-to-surface connectivity features. In this paper, we propose two key innovations to further improve the prediction of multishape evolution. First, for a more accurate cortical surface prediction, instead of simply relying on one neonatal atlas to guide the prediction of the multishape, we propose to use multiple neonatal atlases to build a spatially heterogeneous atlas using the multidirectional varifold representation. This individualizes the atlas by locally maximizing its similarity to the testing baseline cortical shape for each cortical region, thereby better representing the baseline testing cortical surface, which founds the multishape prediction process. Second, for temporally consistent fiber prediction, we propose to reliably estimate spatiotemporal connectivity features using low-rank tensor completion, thereby capturing the variability and richness of the temporal development of fibers. Experimental results confirm that the proposed variants significantly improve the prediction performance of our original multishape prediction framework for both cortical surfaces and fiber tracts shape at 3, 6, and 9 months of age. Our pioneering model will pave the way for learning how to predict the evolution of anatomical shapes with abnormal changes. Ultimately, devising accurate shape evolution prediction models that can help quantify and predict the severity of a brain disorder as it progresses will be of great aid in individualized treatment planning.

Coupled Reconstruction of Cortical Surfaces by Diffeomorphic Mesh Deformation

SurfNN: Joint Reconstruction of Multiple Cortical Surfaces from Magnetic Resonance Images

Reconstruction of Cortical Surfaces with Spherical Topology from Infant Brain MRI via Recurrent Deformation Learning

DeepCSR: A 3D Deep Learning Approach for Cortical Surface Reconstruction

Reconstruction of Central Cortical Surface from Brain MRI Images: Method and Application

Fast Cortical Surface Reconstruction from MRI Using Deep Learning

Neural deformation fields for template-based reconstruction of cortical surfaces from MRI

CortexODE: Learning Cortical Surface Reconstruction by Neural ODEs

Hybrid-CSR: Coupling Explicit and Implicit Shape Representation for Cortical Surface Reconstruction

Vox2Cortex: Fast Explicit Reconstruction of Cortical Surfaces from 3D MRI Scans with Geometric Deep Neural Networks

Joint Prediction of Longitudinal Development of Cortical Surfaces and White Matter Fibers from Neonatal MRI

Joint Reconstruction and Parcellation of Cortical Surfaces

Rapid Brain Meninges Surface Reconstruction with Layer Topology Guarantee

SurfFlow: A Flow-Based Approach for Rapid and Accurate Cortical Surface Reconstruction from Infant Brain MRI

Diffeomorphic Mesh Deformation via Efficient Optimal Transport for Cortical Surface Reconstruction

Cortical Thickness Computation by Solving Tetrahedron-Based Harmonic Field

Topological Correction of Infant White Matter Surfaces Using Anatomically Constrained Convolutional Neural Network

A Deep-Learning Approach For Direct Whole-Heart Mesh Reconstruction

ResAttn-recon: Residual self-attention based cortical surface reconstruction

Toward Evaluation of Multiresolution Cortical Thickness Estimation with FreeSurfer, MaCRUISE, and BrainSuite