Abstract:Background: Schizophrenia (SZ) is a psychiatric condition that adversely affects an individual's cognitive, emotional, and behavioral aspects. The etiology of SZ, although extensively studied, remains unclear, as multiple factors come together to contribute toward its development. There is a consistent body of evidence documenting the presence of structural and functional deviations in the brains of individuals with SZ. Moreover, the hereditary aspect of SZ is supported by the significant involvement of genomics markers. Therefore, the need to investigate SZ from a multi-modal perspective and develop approaches for improved detection arises. Methods: Our proposed method employed a deep learning framework combining features from structural magnetic resonance imaging (sMRI), functional magnetic resonance imaging (fMRI), and genetic markers such as single nucleotide polymorphism (SNP). For sMRI, we used a pre-trained DenseNet to extract the morphological features. To identify the most relevant functional connections in fMRI and SNPs linked to SZ, we applied a 1-dimensional convolutional neural network (CNN) followed by layerwise relevance propagation (LRP). Finally, we concatenated these obtained features across modalities and fed them to the extreme gradient boosting (XGBoost) tree-based classifier to classify SZ from healthy control (HC). Results: Experimental evaluation on clinical dataset demonstrated that, compared to the outcomes obtained from each modality individually, our proposed multi-modal approach performed classification of SZ individuals from HC with an improved accuracy of 79.01%. Conclusion: We proposed a deep learning based framework that selects multi-modal (sMRI, fMRI and genetic) features efficiently and fuse them to obtain improved classification scores. Additionally, by using Explainable AI (XAI), we were able to pinpoint and validate significant functional network connections and SNPs that contributed the most toward SZ classification, providing necessary interpretation behind our findings.

A Novel Diagnosis Method for SZ by Deep Neural Networks.

The Effective Diagnosis of Schizophrenia by Using Multi-Layer RBMs Deep Networks

Sparse deep neural networks on imaging genetics for schizophrenia case–control classification

Multi-modal deep learning from imaging genomic data for schizophrenia classification

A deep learning approach for diagnosis of schizophrenia disorder via data augmentation based on convolutional neural network and long short-term memory

Assisting Schizophrenia Diagnosis Using Clinical Electroencephalography and Interpretable Graph Neural Networks: a Real-World and Cross-Site Study

Diagnosing schizophrenia using deep learning: Novel interpretation approaches and multi-site validation

Early Diagnosis of Alzheimer’s Disease Based on Selective Kernel Network with Spatial Attention

Exploring Schizophrenia Classification Through Multimodal MRI and Deep Graph Neural Networks: Unveiling Brain Region-Specific Weight Discrepancies and Their Association With Cell-Type Specific Transcriptomic Features

RobIn: A Robust Interpretable Deep Network for Schizophrenia Diagnosis

Consistent brain structural abnormalities and multisite individualised classification of schizophrenia using deep neural networks

Bio Marker Identification for Diagnosis of Schizophrenia with Integrated Analysis of Fmri and SNPs

A hybrid deep neural network for classification of schizophrenia using EEG Data

Automatic Diagnosis of Schizophrenia in EEG Signals Using CNN-LSTM Models

A Deep Belief Networks Based Prediction Method for Identification of Disease-Associated Non-coding SNPs in Human Genome.

An Explainable Deep Learning-Based Method For Schizophrenia Diagnosis Using Generative Data-Augmentation

SchizoGoogLeNet: The GoogLeNet-Based Deep Feature Extraction Design for Automatic Detection of Schizophrenia

SSPNet: An interpretable 3D-CNN for classification of schizophrenia using phase maps of resting-state complex-valued fMRI data

Recognition of Early-Onset Schizophrenia Using Deep-Learning Method

Detecting schizophrenia with 3D structural brain MRI using deep learning

Exploring deep residual network based features for automatic schizophrenia detection from EEG