Abstract:A current focus of research in neuroscience is to enumerate, map and annotate neuronal cell types in whole vertebrate brains using different modalities of data acquisition. Mapping these molecular and anatomical datasets into a common reference space remains a key challenge. While several brain-to-atlas mapping workflows exist, they do not adequately address challenges of modern high throughput neuroimaging, including multimodal and multiscale signals, missing data or non reference signals, and geometric quantification of individual variation. Our solution is to implement a generative statistical model that describes the likelihood of imaging data given a sequence of transforms of an atlas image, and a framework for maximum a posteriori estimation of unknown parameters capturing the issues listed above. The key idea in our approach is to minimize the difference between synthetic image volumes and real data over these parameter. Rather than merely using mappings as a “normalization” step, we implement tools for using their local metric changes as an opportunity for geometric quantification of technical and biological sources of variation in an unprecedented manner. While the framework is used to compute pairwise mappings, our approach particularly allows for easy compositions across chains of multimodality datasets. We apply these methods across a broad range of datasets including various combinations of in-vivo and ex-vivo MRI, 3D STP and fMOST data sets, 2D serial histology sections, and brains processed for snRNAseq with tissue partially removed. We show biological utility by quantifying cell density and diffeomorphic characterization of brain shape fluctuations across biological covariates. We note that the magnitude of individual variation is often greater than differences between different sample preparation techniques. To facilitate community accessibility, we implement our algorithm as open source, include a web based framework, and implement input and output dataset standards. Our work establishes a quantitative, scalable and streamlined workflow for unifying a broad spectrum of multi-modal whole-brain light microscopic data volumes into a coordinate-based atlas framework. This work enables large scale integration of whole brain data sets that are essential in modern neuroscience.

The generation of tetrahedral mesh models for neuroanatomical MRI

Fast and high-quality tetrahedral mesh generation from neuroanatomical scans

Image-based Meshing of Patient-Specific Data:Converting Medical Scans into Highly Accurate Computational Models

Anatomical structure modeling from medical images

Volumetric anatomical modeling from medical images

Multi-compartment human head modeling: generating adaptive tetrahedral mesh with GPU acceleration

Improving Model-Based Functional Near-Infrared Spectroscopy Analysis Using Mesh-Based Anatomical and Light-Transport Models

Tetrahedral mesh generation from medical volume data

Solving the problem and quantifying geometric variation in neuroanatomy using generative diffeomorphic mapping

Hexahedral mesh of anatomical atlas for construction of computational human brain models: Applications to modeling biomechanics and bioelectric field propagation

Synthesis of geometrically realistic and watertight neuronal ultrastructure manifolds for in silico modeling

Generative diffeomorphic atlas construction from brain and spinal cord MRI data

Atlas Generation for Subcortical and Ventricular Structures with Its Applications in Shape Analysis

Subdivision meshes for organizing spatial biomedical data

Metadata-conditioned generative models to synthesize anatomically-plausible 3D brain MRIs

Three-dimensional ASM-based Segmentation of the Subcortical Nucleus from Volumetric MR Images

Tetrahedral spectral feature-Based bayesian manifold learning for grey matter morphometry: Findings from the Alzheimer’s disease neuroimaging initiative

Brain MR image simulation for deep learning based medical image analysis networks

Segmentation of Magnetic Resonance Images Using 3D Deformable Models

Research Progress in Tetrahedral Mesh Generation from Medical Volume Data

Voxel2Mesh: 3D Mesh Model Generation from Volumetric Data