Abstract:Biological sex is a crucial variable in neuroscience studies where sex differences have been documented across cognitive functions and neuropsychiatric disorders. While gross statistical differences have been previously documented in macroscopic brain structure such as cortical thickness or region size, less is understood about sex-related cellular-level microstructural differences which could provide insight into brain health and disease. Studying these microstructural differences between men and women paves the way for understanding brain disorders and diseases that manifest differently in different sexes. Diffusion MRI is an important in vivo, non-invasive methodology that provides a window into brain tissue microstructure. Our study develops multiple end-to-end classification models that accurately estimates the sex of a subject using volumetric diffusion MRI data and uses these models to identify white matter regions that differ the most between men and women. 471 male and 560 female healthy subjects (age range, 22–37 years) from the Human Connectome Project are included. Fractional anisotropy, mean diffusivity and mean kurtosis are used to capture brain tissue microstructure characteristics. Diffusion parametric maps are registered to a standard template to reduce bias that can arise from macroscopic anatomical differences like brain size and contour. This study employ three major model architectures: 2D convolutional neural networks, 3D convolutional neural networks and Vision Transformer (with self-supervised pretraining). Our results show that all 3 models achieve high sex classification performance (test AUC 0.92–0.98) across all diffusion metrics indicating definitive differences in white matter tissue microstructure between males and females. We further use complementary model architectures to inform about the pattern of detected microstructural differences and the influence of short-range versus long-range interactions. Occlusion analysis together with Wilcoxon signed-rank test is used to determine which white matter regions contribute most to sex classification. The results indicate that sex-related differences manifest in both local features as well as global features / longer-distance interactions of tissue microstructure. Our highly consistent findings across models provides new insight supporting differences between male and female brain cellular-level tissue organization particularly in the central white matter.

Gender Identification Based on Human Structural MRI with a Multi-layers-vote Algorithm.

Gender Identification of Human Brain Image with A Novel 3D Descriptor

Automatic Head MRI Segmentation Combining FCM and VBM

Prediction of Gender from Longitudinal MRI data via Deep Learning on Adolescent Data Reveals Unique Patterns Associated with Brain Structure and Change over a Two-year Period

Brain Differences Between Men and Women: Evidence From Deep Learning.

Deep learning with diffusion MRI as in vivo microscope reveals sex-related differences in human white matter microstructure

Multimodal Image Analysis of Sexual Dimorphism in Developing Childhood Brain.

Studying the Effects of Sex-related Differences on Brain Age Prediction using brain MR Imaging

A gender recognition method based on EEG microstates

M 3: using mask-attention and multi-scale for multi-modal brain MRI classification

Discriminative analysis of schizophrenia using support vector machine and recursive feature elimination on structural MRI images.

A Novel Brain MRI Image Segmentation Method Using an Improved Multi-View Fuzzy c-Means Clustering Algorithm

Combined Support Vector Machine Classifier and Brain Structural Network Features for the Individual Classification of Amnestic Mild Cognitive Impairment and Subjective Cognitive Decline Patients

Classification of MRI and Psychological Testing Data Based on Support Vector Machine.

MMM: Classification of Schizophrenia Using Multi-Modality Multi-Atlas Feature Representation and Multi-Kernel Learning.

A Multi-Modal and Multi-Atlas Integrated Framework for Identification of Mild Cognitive Impairment

M3: using mask-attention and multi-scale for multi-modal brain MRI classification

Groupwise structural sparsity for discriminative voxels identification

Sex classification of 3D skull images using deep neural networks

Automatic detection of cognitive impairment in patients with white matter hyperintensity and causal analysis of related factors using artificial intelligence of MRI

Interpretation of 3D CNNs for Brain MRI Data Classification