Abstract:Background: Material characterization of brain white matter (BWM) is difficult due to the anisotropy inherent to the three-dimensional microstructure and the various interactions between heterogeneous brain-tissue (axon, myelin, and glia). Developing full scale finite element models that accurately represent the relationship between the micro and macroscale BWM is however extremely challenging and computationally expensive. The anisotropic properties of the microstructure of BWM computed by building unit cells under frequency domain viscoelastic characterization comprises of 36 individual constants each, for the loss and storage moduli. Furthermore, the architecture of each unit cell is arbitrary in an infinite dataset. Methods: In this study, we extend our previous work on developing representative volume elements (RVE) of the microstructure of the BWM in the frequency domain to develop 3D deep learning algorithms that can predict the anisotropic composite properties. The deep 3D convolutional neural network (CNN) algorithms utilizes a voxelization method to obtain geometry information from 3D RVEs. The architecture information encoded in the voxelized location is employed as input data while cross-referencing the RVEs' material properties (output data). We further develop methods by incorporating parallel pathways, Residual Neural Networks and inception modulus that improve the efficiency of deep learning algorithms. Results: This paper presents different CNN algorithms in predicting the anisotropic composite properties of BWM. A quantitative analysis of the individual algorithms is presented with the view of identifying optimal strategies to interpret the combined measurements of brain MRE and DTI. Significance: The proposed Multiscale 3D ResNet (M3DR) algorithm demonstrates high learning ability and performance over baseline CNN algorithms in prediciting BWM tissue properties. The hybrid M3DR framerwork also overcomes the significant limitations encountered in modeling brain tissue using finite elements alone including those such as high computational cost, mesh and simulation failure. The proposed framework also provides an efficient and streamlined platform for implementing complex boundary conditions, modeling intrinsic material properties and imparting interfacial architecture information.

Multiscale Multimodal Medical Imaging - First International Workshop, MMMI 2019, Held in Conjunction with MICCAI 2019, Shenzhen, China, October 13, 2019, Proceedings

Three-dimensional Simultaneous Brain Mapping of T1, T2, T2*and Magnetic Susceptibility with MR Multitasking

Mmformer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation

Integrated Brain Connectivity Analysis with fMRI, DTI, and sMRI Powered by Interpretable Graph Neural Networks

The Method of Multimodal MRI Brain Image Segmentation Based on Differential Geometric Features

Multi-scale and Multimodal Fusion of Tract-tracing, Myelin Stain and DTI-derived Fibers in Macaque Brains

On the application of hybrid deep 3D convolutional neural network algorithms for predicting the micromechanics of brain white matter

Multi-Center Brain Imaging Classification Using a Novel 3D CNN Approach.

Predicting Cortical ROIs Via Joint Modeling of Anatomical and Connectional Profiles.

Dynamic Structural Brain Network Construction by Hierarchical Prototype Embedding GCN using T1-MRI

Multi-Modality Conditioned Variational U-Net for Field-of-View Extension in Brain Diffusion MRI

Multimodal Infant Brain Segmentation by Fuzzy-Informed Deep Learning

Enhancing Diffusion MRI Measures by Integrating Grey and White Matter Morphometry with Hyperbolic Wasserstein Distance.

DCT-net: Dual-domain cross-fusion transformer network for MRI reconstruction

An End-to-end Multimodal 3D CNN Framework with Multi-level Features for the Prediction of Mild Cognitive Impairment

M 3: using mask-attention and multi-scale for multi-modal brain MRI classification

3D MRI Image Super-Resolution for Brain Combining Rigid and Large Diffeomorphic Registration

A Multi-channel Network with Image Retrieval for Accurate Brain Tissue Segmentation

A Unified Conditional Disentanglement Framework for Multimodal Brain MR Image Translation

Multi-task Deep Learning for Cerebrovascular Disease Classification and MRI-to-PET Translation