Graph Neural Networks in EEG-based Emotion Recognition: A Survey

Chenyu Liu,Xinliang Zhou,Yihao Wu,Ruizhi Yang,Zhongruo Wang,Liming Zhai,Ziyu Jia,Yang Liu
2024-08-30
Abstract:Compared to other modalities, EEG-based emotion recognition can intuitively respond to the emotional patterns in the human brain and, therefore, has become one of the most concerning tasks in the brain-computer interfaces field. Since dependencies within brain regions are closely related to emotion, a significant trend is to develop Graph Neural Networks (GNNs) for EEG-based emotion recognition. However, brain region dependencies in emotional EEG have physiological bases that distinguish GNNs in this field from those in other time series fields. Besides, there is neither a comprehensive review nor guidance for constructing GNNs in EEG-based emotion recognition. In the survey, our categorization reveals the commonalities and differences of existing approaches under a unified framework of graph construction. We analyze and categorize methods from three stages in the framework to provide clear guidance on constructing GNNs in EEG-based emotion recognition. In addition, we discuss several open challenges and future directions, such as Temporal full-connected graph and Graph condensation.
Signal Processing,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to effectively use graph neural networks (GNNs) to model the dependency relationships between brain regions in electroencephalogram (EEG) - based emotion recognition. Specifically, the paper focuses on the following aspects: 1. **Review of existing methods**: The paper conducts a comprehensive review of the existing GNN - based emotion recognition methods, reveals the commonalities and differences in constructing graph structures among these methods, and proposes a unified framework to classify the existing methods. 2. **Guide GNN construction**: By analyzing and classifying the three stages (node - level, edge - level, and graph - level) of methods, the paper provides clear guidance for constructing GNNs for EEG emotion recognition. 3. **Explore open challenges and future directions**: The paper discusses several open challenges and future research directions, such as fully - connected temporal graphs and graph condensation, aiming to promote the further development of this field. ### Main contributions of the paper: - **Systematic review**: This is the first review work specifically for GNN - based EEG emotion recognition, providing a comprehensive and systematic review. - **Novel classification**: A new classification method is proposed to classify existing methods according to the unified GNN construction framework, providing clear guidance for constructing specific GNNs. - **Future directions**: Future research directions are summarized and emphasized to promote the development of GNN - based EEG emotion recognition. ### Structure of the paper: - **Introduction**: Introduces the importance of emotion recognition, especially EEG - based emotion recognition, and points out the application and advantages of GNNs in this field. - **Classification overview**: Describes the classification method of the paper, with the focus on the three stages of node selection, edge calculation, and graph structure construction. - **Node - level stage**: Details the selection of node features, including univariate nodes and mixed nodes. - **Edge - level stage**: Discusses the calculation methods of edge matrices, which are divided into model - independent edges and model - dependent edges. - **Graph - level stage**: Explores different types of graph structures, including multi - graphs, hierarchical graphs, time - series graphs, and sparse graphs. Through these contents, the paper not only provides a systematic reference framework for researchers but also points out the future research directions in this field, which has important academic value and practical application prospects.