Abstract:Biological sex is a crucial variable in neuroscience studies where sex differences have been documented across cognitive functions and neuropsychiatric disorders. While gross statistical differences have been previously documented in macroscopic brain structure such as cortical thickness or region size, less is understood about sex-related cellular-level microstructural differences which could provide insight into brain health and disease. Studying these microstructural differences between men and women paves the way for understanding brain disorders and diseases that manifest differently in different sexes. Diffusion MRI is an important in vivo, non-invasive methodology that provides a window into brain tissue microstructure. Our study develops multiple end-to-end classification models that accurately estimates the sex of a subject using volumetric diffusion MRI data and uses these models to identify white matter regions that differ the most between men and women. 471 male and 560 female healthy subjects (age range, 22–37 years) from the Human Connectome Project are included. Fractional anisotropy, mean diffusivity and mean kurtosis are used to capture brain tissue microstructure characteristics. Diffusion parametric maps are registered to a standard template to reduce bias that can arise from macroscopic anatomical differences like brain size and contour. This study employ three major model architectures: 2D convolutional neural networks, 3D convolutional neural networks and Vision Transformer (with self-supervised pretraining). Our results show that all 3 models achieve high sex classification performance (test AUC 0.92–0.98) across all diffusion metrics indicating definitive differences in white matter tissue microstructure between males and females. We further use complementary model architectures to inform about the pattern of detected microstructural differences and the influence of short-range versus long-range interactions. Occlusion analysis together with Wilcoxon signed-rank test is used to determine which white matter regions contribute most to sex classification. The results indicate that sex-related differences manifest in both local features as well as global features / longer-distance interactions of tissue microstructure. Our highly consistent findings across models provides new insight supporting differences between male and female brain cellular-level tissue organization particularly in the central white matter.

Dense-CAM: Visualize the Gender of Brains with MRI Images

Exclusive Feature Constrained Class Activation Mapping for Better Visual Explanation.

Interpretation of 3D CNNs for Brain MRI Data Classification

Brain Differences Between Men and Women: Evidence From Deep Learning.

Gender Identification Based on Human Brain Structural MRI with a Multi-Layer 3D Convolution Extreme Learning Machine.

Analysis of Gender Differences in the Brain Based on Deep Learning

Gender Identification of Human Brain Image with A Novel 3D Descriptor

Respond-CAM: Analyzing Deep Models for 3D Imaging Data by Visualizations

Exploring Gender Differences Based on Functional Magnetic Resonance Images by Deep Learning and Gradient-weighted Class Activation Mapping.

Interpretable Multimodal Fusion Networks Reveal Mechanisms of Brain Cognition

Stochastic encoding of graphs in deep learning allows for complex analysis of gender classification in resting-state and task functional brain networks from the UK Biobank

Deep learning with diffusion MRI as in vivo microscope reveals sex-related differences in human white matter microstructure

Multi-Center Brain Imaging Classification Using a Novel 3D CNN Approach.

Enhancing brain tumor detection in MRI images through explainable AI using Grad-CAM with Resnet 50

Cluster-CAM: Cluster-weighted visual interpretation of CNNs' decision in image classification

UM-CAM: Uncertainty-weighted Multi-resolution Class Activation Maps for Weakly-supervised Fetal Brain Segmentation

Gender Identification Based on Human Structural MRI with a Multi-layers-vote Algorithm.

Simulating Realistic MRI variations to Improve Deep Learning model and visual explanations using GradCAM

MSG-CAM:Multi-scale inputs make a better visual interpretation of CNN networks

Prediction of Gender from Longitudinal MRI data via Deep Learning on Adolescent Data Reveals Unique Patterns Associated with Brain Structure and Change over a Two-year Period

CAManim: Animating end-to-end network activation maps