Abstract:A current focus of research in neuroscience is to enumerate, map and annotate neuronal cell types in whole vertebrate brains using different modalities of data acquisition. Mapping these molecular and anatomical datasets into a common reference space remains a key challenge. While several brain-to-atlas mapping workflows exist, they do not adequately address challenges of modern high throughput neuroimaging, including multimodal and multiscale signals, missing data or non reference signals, and geometric quantification of individual variation. Our solution is to implement a generative statistical model that describes the likelihood of imaging data given a sequence of transforms of an atlas image, and a framework for maximum a posteriori estimation of unknown parameters capturing the issues listed above. The key idea in our approach is to minimize the difference between synthetic image volumes and real data over these parameter. Rather than merely using mappings as a “normalization” step, we implement tools for using their local metric changes as an opportunity for geometric quantification of technical and biological sources of variation in an unprecedented manner. While the framework is used to compute pairwise mappings, our approach particularly allows for easy compositions across chains of multimodality datasets. We apply these methods across a broad range of datasets including various combinations of in-vivo and ex-vivo MRI, 3D STP and fMOST data sets, 2D serial histology sections, and brains processed for snRNAseq with tissue partially removed. We show biological utility by quantifying cell density and diffeomorphic characterization of brain shape fluctuations across biological covariates. We note that the magnitude of individual variation is often greater than differences between different sample preparation techniques. To facilitate community accessibility, we implement our algorithm as open source, include a web based framework, and implement input and output dataset standards. Our work establishes a quantitative, scalable and streamlined workflow for unifying a broad spectrum of multi-modal whole-brain light microscopic data volumes into a coordinate-based atlas framework. This work enables large scale integration of whole brain data sets that are essential in modern neuroscience.

Mondrian Abstraction and Language Model Embeddings for Differential Pathway Analysis

Automatically layout and visualize the biological pathway map with spectral graph theory

Mondrian Processes for Flow Cytometry Analysis

Brain Modulyzer: Interactive Visual Analysis of Functional Brain Connectivity

Product Manifold Representations for Learning on Biological Pathways

Monosynaptically-interconnected Network Module (MNM) Approach for High-Resolution Brain Sub-Network Analysis

Solving the problem and quantifying geometric variation in neuroanatomy using generative diffeomorphic mapping

BG-GAN: Generative AI Enables Representing Brain Structure-Function Connections for Alzheimer's Disease

BAI-Net: Individualized Anatomical Cerebral Cartography Using Graph Neural Network

Graph Models for Biological Pathway Visualization: State of the Art and Future Challenges

Pathway-based visualization of cross-platform microarray datasets

Morphological Feature Visualization of Alzheimer's Disease via Multidirectional Perception GAN

Interpreting and visualizing pathway analyses using embedding representations with PAVER

Integrated Brain Connectivity Analysis with fMRI, DTI, and sMRI Powered by Interpretable Graph Neural Networks

Cross-modality mapping using image varifolds to align tissue-scale atlases to molecular-scale measures with application to 2D brain sections

Image Varifolds on Meshes for Mapping Spatial Transcriptomics

Genomics data analysis via spectral shape and topology

mosaicMPI: a framework for modular data integration across cohorts and -omics modalities

GraphPath: a graph attention model for molecular stratification with interpretability based on the pathway-pathway interaction network

DEMA: a Distance-Bounded Energy-Field Minimization Algorithm to Model and Layout Biomolecular Networks with Quantitative Features