Abstract:Background: There is an unfulfilled need to find the best way to automatically capture, analyze, organize, and merge structural and functional brain magnetic resonance imaging (MRI) data to ultimately extract relevant signals that can assist the medical decision process at the bedside of patients in postanoxic coma. We aimed to develop and validate a deep learning model to leverage multimodal 3D MRI whole-brain times series for an early evaluation of brain damages related to anoxoischemic coma. Methods: This proof-of-concept, prospective, cohort study was undertaken at the intensive care unit affiliated with the University Hospital (Toulouse, France), between March 2018 and May 2020. All patients were scanned in coma state at least 2 days (4 ± 2 days) after cardiac arrest. Over the same period, age-matched healthy volunteers were recruited and included. Brain MRI quantification encompassed both "functional data" from regions of interest (precuneus and posterior cingulate cortex) with whole-brain functional connectivity analysis and "structural data" (gray matter volume, T1-weighted, fractional anisotropy, and mean diffusivity). A specifically designed 3D convolutional neuronal network (CNN) was created to allow conscious state discrimination (coma vs. controls) by using raw MRI indices as the input. A voxel-wise visualization method based on the study of convolutional filters was applied to support CNN outcome. The Ethics Committee of the University Teaching Hospital of Toulouse, France (2018-A31) approved the study and informed consent was obtained from all participants. Results: The final cohort consisted of 29 patients in postanoxic coma and 34 healthy volunteers. Coma patients were successfully discerned from controls by using 3D CNN in combination with different MR indices. The best accuracy was achieved by functional MRI data, in particular with resting-state functional MRI of the posterior cingulate cortex, with an accuracy of 0.96 (range 0.94-0.98) on the test set from 10-time repeated tenfold cross-validation. Even more satisfactory performances were achieved through the majority voting strategy, which was able to compensate for mistakes from single MR indices. Visualization maps allowed us to identify the most relevant regions for each MRI index, notably regions previously described as possibly being involved in consciousness emergence. Interestingly, a posteriori analysis of misclassified patients indicated that they may present some common functional MRI traits with controls, which suggests further favorable outcomes. Conclusions: A fully automated identification of clinically relevant signals from complex multimodal neuroimaging data is a major research topic that may bring a radical paradigm shift in the neuroprognostication of patients with severe brain injury. We report for the first time a successful discrimination between patients in postanoxic coma patients from people serving as controls by using 3D CNN whole-brain structural and functional MRI data. Clinical Trial Number http://ClinicalTrials.gov (No. NCT03482115).

Investigating the discrimination ability of 3D convolutional neural networks applied to altered brain MRI parametric maps

Interpretation of 3D CNNs for Brain MRI Data Classification

Visualizing Convolutional Networks for MRI-based Diagnosis of Alzheimer's Disease

Automated detection of critical findings in multi-parametric brain MRI using a system of 3D neural networks

Understanding 3D CNN Behavior for Alzheimer's Disease Diagnosis from Brain PET Scan

Automated classification of Alzheimer's disease, mild cognitive impairment, and cognitively normal patients using 3D convolutional neural network and radiomic features from T1-weighted brain MRI: A comparative study on detection accuracy

Discriminating between benign and malignant breast tumors using 3D convolutional neural network in dynamic contrast enhanced-MR images

Differentiation Between Glioblastoma and Metastatic Disease on Conventional MRI Imaging Using 3D-Convolutional Neural Networks: Model Development and Validation

AXIAL: Attention-based eXplainability for Interpretable Alzheimer's Localized Diagnosis using 2D CNNs on 3D MRI brain scans

Discriminative analysis of schizophrenia patients using an integrated model combining 3D CNN with 2D CNN: A multimodal MR image and connectomics analysis

Construction of MRI-Based Alzheimer's Disease Score Based on Efficient 3D Convolutional Neural Network: Comprehensive Validation on 7,902 Images from a Multi-Center Dataset.

A Multichannel 2D Convolutional Neural Network Model for Task-Evoked fMRI Data Classification

Image Thresholding Improves 3-Dimensional Convolutional Neural Network Diagnosis of Different Acute Brain Hemorrhages on Computed Tomography Scans.

3D Compressed Convolutional Neural Network Differentiates Neuromyelitis Optical Spectrum Disorders From Multiple Sclerosis Using Automated White Matter Hyperintensities Segmentations

Deep Learning and Transfer Learning for Brain Tumor Detection and Classification

Adopting transfer learning for neuroimaging: a comparative analysis with a custom 3D convolution neural network model

Multimodal MRI-Based Whole-Brain Assessment in Patients In Anoxoischemic Coma by Using 3D Convolutional Neural Networks

An analysis of data leakage and generalizability in MRI based classification of Parkinson's Disease using explainable 2D Convolutional Neural Networks

Classification of Subcortical Vascular Cognitive Impairment Using Single MRI Sequence and Deep Learning Convolutional Neural Networks

A Novel Multimodal MRI Analysis for Alzheimer's Disease Based on Convolutional Neural Network

Efficient 3D Neural Networks with Support Vector Machine for Hippocampus Segmentation