Abstract:Schizophrenia (SCZ) is a chronic and serious mental disorder with a high mortality rate. At present, there is a lack of objective, cost-effective and widely disseminated diagnosis tools to address this mental health crisis globally. Clinical electroencephalogram (EEG) is a noninvasive technique to measure brain activity with high temporal resolution, and accumulating evidence demonstrates that clinical EEG is capable of capturing abnormal SCZ neuropathology. Although EEG-based automated diagnostic tools have obtained impressive performance on individual datasets, the transportability of potential EEG biomarkers in cross-site real-world application is still an open question. To address the challenges of small sample sizes and population heterogeneity, we develop an advanced interpretable deep learning model using multimodal clinical EEG features and demographic information as inputs to graph neural networks, and further propose different transfer learning strategies to adapt to different clinical scenarios. Taking the disease discrimination of health control (HC) and SCZ with 1030 participants as a use case, our model is trained on a small clinical dataset (N = 188, Chinese) and enhanced using a large-scale public dataset (N = 508, American) of adult participants. Cross-site validation from an independent dataset of adult participants (N = 157, Chinese) produced stable performance, with AUCs of 0.793–0.852 and accuracies of 0.786–0.858 for different SCZ prevalence, respectively. In addition, cross-site validation from another dataset of adolescent boys (N = 84, Russian) yielded an AUC of 0.702 and an accuracy of 0.690. Moreover, feature visualization further revealed that the ranking of feature importance varied significantly among different datasets, and that EEG theta and alpha band power appeared to be the most significant and translational biomarkers of SCZ pathology. Overall, our promising results demonstrate the feasibility of SCZ discrimination using EEG biomarkers in multiple clinical settings.

A Cross-modality Deep Learning Method for Measuring Decision Confidence from Eye Movement Signals

EEG-Eye Movements Cross-Modal Decision Confidence Measurement with Generative Adversarial Networks

Discrimination of Decision Confidence Levels from EEG Signals

EEG-Based Human Decision Confidence Measurement Using Graph Neural Networks

Cross-Subject Decision Confidence Estimation from EEG Signals Using Spectral-Spatial-Temporal Adaptive GCN with Domain Adaptation.

Measuring Decision Confidence Levels from EEG Using a Spectral-Spatial-Temporal Adaptive Graph Convolutional Neural Network.

Deep Learning for Micro-Electrocorticographic (µecog) Data

Assisting Schizophrenia Diagnosis Using Clinical Electroencephalography and Interpretable Graph Neural Networks: a Real-World and Cross-Site Study

Enhancing EEG-Based Decision-Making Performance Prediction by Maximizing Mutual Information Between Emotion and Decision-Relevant Features

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Multimodal Emotion Recognition from Eye Image, Eye Movement and EEG Using Deep Neural Networks

Prediction of Product Design Decision Making: an Investigation of Eye Movements and EEG Features

Multimodal fusion for anticipating human decision performance

Residual self-calibrated network with multi-scale channel attention for accurate EOG-based eye movement classification.

A Cross-Culture Study on Multimodal Emotion Recognition Using Deep Learning

A Cross-subject and Cross-modal Model for Multimodal Emotion Recognition

Simplifying Multimodal Emotion Recognition with Single Eye Movement Modality

Multimodal Emotion Recognition based on the Fusion of EEG Signals and Eye Movement Data

Cross-Modal Guiding Neural Network for Multimodal Emotion Recognition From EEG and Eye Movement Signals

Motor imagery recognition with automatic EEG channel selection and deep learning

Multimodal Emotion Recognition Using Deep Canonical Correlation Analysis