Abstract:The human brain can be modeled as multiple interrelated shapes (or a multishape), each for characterizing one aspect of the brain, such as the cortex and white matter pathways. Predicting the developing multishape is a very challenging task due to the contrasting nature of the developmental trajectories of the constituent shapes: smooth for the cortical surface and non-smooth for white matter tracts due to changes such as bifurcation. We recently addressed this problem and proposed an approach for predicting the multishape developmental spatiotemporal trajectories of infant brains based only on neonatal MRI data using a set of geometric, dynamic, and fiber-to-surface connectivity features. In this paper, we propose two key innovations to further improve the prediction of multishape evolution. First, for a more accurate cortical surface prediction, instead of simply relying on one neonatal atlas to guide the prediction of the multishape, we propose to use multiple neonatal atlases to build a spatially heterogeneous atlas using the multidirectional varifold representation. This individualizes the atlas by locally maximizing its similarity to the testing baseline cortical shape for each cortical region, thereby better representing the baseline testing cortical surface, which founds the multishape prediction process. Second, for temporally consistent fiber prediction, we propose to reliably estimate spatiotemporal connectivity features using low-rank tensor completion, thereby capturing the variability and richness of the temporal development of fibers. Experimental results confirm that the proposed variants significantly improve the prediction performance of our original multishape prediction framework for both cortical surfaces and fiber tracts shape at 3, 6, and 9 months of age. Our pioneering model will pave the way for learning how to predict the evolution of anatomical shapes with abnormal changes. Ultimately, devising accurate shape evolution prediction models that can help quantify and predict the severity of a brain disorder as it progresses will be of great aid in individualized treatment planning.

Spherical Transformer for Quality Assessment of Pediatric Cortical Surfaces.

ScaleFormer: Revisiting the Transformer-based Backbones from a Scale-wise Perspective for Medical Image Segmentation.

Spherical Transformer: Adapting Spherical Signal to CNNs

Reconstruction of Cortical Surfaces with Spherical Topology from Infant Brain MRI via Recurrent Deformation Learning

Joint Prediction of Longitudinal Development of Cortical Surfaces and White Matter Fibers from Neonatal MRI

Topological Correction of Infant White Matter Surfaces Using Anatomically Constrained Convolutional Neural Network

3D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentation

Cortical surface registration using unsupervised learning

Discriminative analysis of the human cortex using spherical CNNs - a study on Alzheimer's disease diagnosis

TW-Net: Transformer Weighted Network for Neonatal Brain MRI Segmentation

S3Reg: Superfast Spherical Surface Registration Based on Deep Learning

MCRformer: Morphological constraint reticular transformer for 3D medical image segmentation

Spatial Transformer for 3D Point Clouds

SGFormer: Spherical Geometry Transformer for 360 Depth Estimation

ConvFormer: Plug-and-Play CNN-Style Transformers for Improving Medical Image Segmentation

Perception-Oriented U-Shaped Transformer Network for 360-Degree No-Reference Image Quality Assessment

TransSea: Hybrid CNN-Transformer with Semantic Awareness for 3D Brain Tumor Segmentation

Spherical convolutional neural networks can improve brain microstructure estimation from diffusion MRI data

Cortical Surface Shape Analysis Based on Spherical

Coupled Reconstruction of Cortical Surfaces by Diffeomorphic Mesh Deformation

Slimmable transformer with hybrid axial-attention for medical image segmentation