LY 503430 , a novel AMPA receptor potentiator with functional , neuroprotective and neurotrophic effects in rodent models of Parkinson ’ s disease

T. Murray,Katherine Whalley,C. Robinson,M. Ward,C. Hicks,D. Lodge,Jim L. Vandergriff,P. Baumbarger,E. Siuda,M. Gates,A. Ogden,P. Skolnick,D. Zimmerman,E. Nisenbaum,D. Bleakman

Abstract:

What problem does this paper attempt to address?

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Chao Li,Yong Sheng,Haishuai Wang,Mingyue Niu,Peiguang Jing,Ziping Zhao,Bjorn W Schuller

DOI: https://doi.org/10.1109/embc48229.2022.9871072

2022-01-01

Abstract:In recent years, due to the fundamental role played by the central nervous system in emotion expression, electroencephalogram (EEG) signals have emerged as the most robust signals for use in emotion recognition and inference. Current emotion recognition methods mainly employ deep learning technology to learn the spatial or temporal representation of each channel, then obtain complementary information from different EEG channels by adopting a multi-modal fusion strategy. However, emotional expression is usually accompanied by the dynamic spatio-temporal evolution of functional connections in the brain. Therefore, the effective learning of more robust long-term dynamic representations for the brain's functional connection networks is a key to improving the EEG-based emotion recognition system. To address these issues, we propose a brain network representation learning method that employs self-attention dynamic graph neural networks to obtain the spatial structure information and temporal evolution characteristics of brain networks. Experimental results on the AMIGOS dataset show that the proposed method is superior to the state-of-the-art methods.
Attention-based Temporal Graph Representation Learning for EEG-based Emotion Recognition

Chao Li,Feng Wang,Ziping Zhao,Haishuai Wang,Bjorn W. Schuller

DOI: https://doi.org/10.1109/jbhi.2024.3395622

2024-01-01

Abstract:Due to the objectivity of emotional expression in the central nervous system, EEG-based emotion recognition can effectively reflect humans' internal emotional states. In recent years, convolutional neural networks (CNNs) and recurrent neural networks (RNNs) have made significant strides in extracting local features and temporal dependencies from EEG signals. However, CNNs ignore spatial distribution information from EEG electrodes; moreover, RNNs may encounter issues such as exploding/vanishing gradients and high time consumption. To address these limitations, we propose an attention-based temporal graph representation network (ATGRNet) for EEG-based emotion recognition. Firstly, a hierarchical attention mechanism is introduced to integrate feature representations from both frequency bands and channels ordered by priority in EEG signals. Second, a graph convolutional neural network with top-k operation is utilized to capture internal relationships between EEG electrodes under different emotion patterns. Next, a residual-based graph readout mechanism is applied to accumulate the EEG feature node-level representations into graph-level representations. Finally, the obtained graph-level representations are fed into a temporal convolutional network (TCN) to extract the temporal dependencies between EEG frames. We evaluated our proposed ATGRNet on the SEED, DEAP and FACED datasets. The experimental findings show that the proposed ATGRNet surpasses the state-of-the-art graph-based mehtods for EEG-based emotion recognition.
EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM

Yongqiang Yin,Xiangwei Zheng,Bin Hu,Yuang Zhang,Xinchun Cui

DOI: https://doi.org/10.1016/j.asoc.2020.106954

IF: 8.7

2021-03-01

Applied Soft Computing

Abstract:In recent years, graph convolutional neural networks have become research focus and inspired new ideas for emotion recognition based on EEG. Deep learning has been widely used in emotion recognition, but it is still challenging to construct models and algorithms in practical applications. In this paper, we propose a novel emotion recognition method based on a novel deep learning model (ERDL). Firstly, EEG data is calibrated by 3s baseline data and divided into segments with 6s time window, and then differential entropy is extracted from each segment to construct feature cube. Secondly, the feature cube of each segment serves as input of the novel deep learning model which fuses graph convolutional neural network (GCNN) and long-short term memories neural networks (LSTM). In the fusion model, multiple GCNNs are applied to extract graph domain features while LSTM cells are used to memorize the change of the relationship between two channels within a specific time and extract temporal features, and Dense layer is used to attain the emotion classification results. At last, we conducted extensive experiments on DEAP dataset and experimental results demonstrate that the proposed method has better classification results than the state-of-the-art methods. We attained the average classification accuracy of 90.45% and 90.60% for valence and arousal in subject-dependent experiments while 84.81% and 85.27% in subject-independent experiments.

computer science, artificial intelligence, interdisciplinary applications
EEG-Based Emotion Recognition Using Partial Directed Coherence Dense Graph Propagation

ZhongMin Wang,Yang Liu,Rong Zhang,Jie Zhang,XiaoMin Guo

DOI: https://doi.org/10.1109/icmtma54903.2022.00127

2022-01-01

Abstract:In order to preserve the EEG time-frequency domain features while fully uncovering the information flow and spatial information in the causal connectivity of relevant brain regions, this paper proposes a multichannel EEG signal emotion recognition method based on partial directed coherence dense graph propagation. The proposed method mainly uses partial directed coherence (PDC) to construct causal brain networks, which is used to describe the interactions and information flow relationships between different nodes or brain regions in the brain, and uses a modified model of dense graph propagation (DGP) in graph convolutional neural networks to train the graph data modeled by multichannel causal connectivity information of EEG signals and single-channel time-frequency domain features. Unlike traditional graph convolutional neural networks, the PDC-DGP model focuses on the directedness of the graph and does not dilute the feature information of the graph data by extensive smoothing. We investigate on two publicly available datasets, DEAP and SEED, and the results show that the method has good recognition performance on both datasets, and the average accurate recognition rate can be as high as 85.25% on SEED and 77.37% and 76.92% on the DEAP dataset for valence and arousal, respectively.
EDA-Graph: Graph Signal Processing of Electrodermal Activity for Emotional States Detection

Luis R Mercado-Diaz,Yedukondala Rao Veeranki,Fernando Marmolejo-Ramos,Hugo F Posada-Quintero

DOI: https://doi.org/10.1109/JBHI.2024.3405491

Abstract:The continuous detection of emotional states has many applications in mental health, marketing, human-computer interaction, and assistive robotics. Electrodermal activity (EDA), a signal modulated by sympathetic nervous system activity, provides continuous insight into emotional states. However, EDA possesses intricate nonstationary and nonlinear characteristics, making the extraction of emotion-relevant information challenging. We propose a novel graph signal processing (GSP) approach to model EDA signals as graphical networks, termed EDA-graph. The GSP leverages graph theory concepts to capture complex relationships in time-series data. To test the usefulness of EDA-graphs to detect emotions, we processed EDA recordings from the CASE emotion dataset using GSP by quantizing and linking values based on the Euclidean distance between the nearest neighbors. From these EDA-graphs, we computed the features of graph analysis, including total load centrality (TLC), total harmonic centrality (THC), number of cliques (GNC), diameter, and graph radius, and compared those features with features obtained using traditional EDA processing techniques. EDA-graph features encompassing TLC, THC, GNC, diameter, and radius demonstrated significant differences (p < 0.05) between five emotional states (Neutral, Amused, Bored, Relaxed, and Scared). Using machine learning models for classifying emotional states evaluated using leave-one-subject-out cross-validation, we achieved a five-class F1 score of up to 0.68.
Spatial-temporal features-based EEG emotion recognition using graph convolution network and long short-term memory

Fa Zheng,Bin Hu,Xiangwei Zheng,Yuang Zhang

DOI: https://doi.org/10.1088/1361-6579/acd675

2023-06-08

Abstract:Objective. Emotion recognition on the basis of electroencephalography (EEG) signals has received a significant amount of attention in the areas of cognitive science and human-computer interaction (HCI). However, most existing studies either focus on one-dimensional EEG data, ignoring the relationship between channels, or only extract time-frequency features while not involving spatial features.Approach. We develop spatial-temporal features-based EEG emotion recognition using a graph convolution network (GCN) and long short-term memory (LSTM), named ERGL. First, the one-dimensional EEG vector is converted into a two-dimensional mesh matrix, so that the matrix configuration corresponds to the distribution of brain regions at EEG electrode locations, thus to represent the spatial correlation between multiple adjacent channels in a better way. Second, the GCN and LSTM are employed together to extract spatial-temporal features; the GCN is used to extract spatial features, while LSTM units are applied to extract temporal features. Finally, a softmax layer is applied to emotion classification.Main results. Extensive experiments are conducted on the A Dataset for Emotion Analysis using Physiological Signals (DEAP) and the SJTU Emotion EEG Dataset (SEED). The classification results of accuracy, precision, and F-score for valence and arousal dimensions on DEAP achieved 90.67% and 90.33%, 92.38% and 91.72%, and 91.34% and 90.86%, respectively. The accuracy, precision, and F-score of positive, neutral, and negative classifications reached 94.92%, 95.34%, and 94.17%, respectively, on the SEED dataset.Significance. The above results demonstrate that the proposed ERGL method is encouraging in comparison to state-of-the-art recognition research.
Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Jiaheng Wang,Yueming Wang,Lin Yao

DOI: https://doi.org/10.7507/1001-5515.202012054

2021-01-01

Abstract:Emotion plays an important role in people's cognition and communication. By analyzing electroencephalogram (EEG) signals to identify internal emotions and feedback emotional information in an active or passive way, affective brain-computer interactions can effectively promote human-computer interaction. This paper focuses on emotion recognition using EEG. We systematically evaluate the performance of state-of-the-art feature extraction and classification methods with a public-available dataset for emotion analysis using physiological signals (DEAP). The common random split method will lead to high correlation between training and testing samples. Thus, we use block-wise fold cross validation. Moreover, we compare the accuracy of emotion recognition with different time window length. The experimental results indicate that 4 s time window is appropriate for sampling. Filter-bank long short-term memory networks (FBLSTM) using differential entropy features as input was proposed. The average accuracy of low and high in valance dimension, arousal dimension and combination of the four in valance-arousal plane is 78.8%, 78.4% and 70.3%, respectively. These results demonstrate the advantage of our emotion recognition model over the current studies in terms of classification accuracy. Our model might provide a novel method for emotion recognition in affective brain-computer interactions.
Emotion Recognition By Edge-Weighted Hypergraph Neural Network

Jingzhi Shao,Junjie Zhu,Yuxuan Wei,Yifan Feng,Xibin Zhao

DOI: https://doi.org/10.1109/icip.2019.8803207

2019-01-01

Abstract:Over the past decade, increasing research efforts have been concentrated on emotion recognition from physiological signals due to their capability on emotion information representation. Existing works mainly focus on exploring the relationship between stimulus and subjects, while ignoring the effects of latent correlations among different subjects, which are important for personalized emotion recognition. To tackle this issue, we aim to conduct emotion recognition using multi-modal physiological signals through an edge-weighted hypergraph neural network, in which complex relationship among subjects is formulated using hypergraph for each modality respectively. In our model, the differences in significance of influence which various samples leave on the classification can be better represented. The major contribution of this network lies in its concern that the associate strengths between various samples are different, which have different impact on the training result. The hyperedge between the vertices with closer correlation should be assigned a larger weight. Reversely, the looser relation, the minor weight. To evaluate the proposed method, experiments have been conducted on the DEAP dataset and ASCERTAIN dataset. Experimental results and comparison with state-of-the-art methods show that the proposed method can achieve better performance.
An Efficient Graph Learning System for Emotion Recognition Inspired by the Cognitive Prior Graph of EEG Brain Network

Cunbo Li,Tian Tang,Yue Pan,Lei Yang,Shuhan Zhang,Zhaojin Chen,Peiyang Li,Dongrui Gao,Huafu Chen,Fali Li,Dezhong Yao,Zehong Cao,Peng Xu

DOI: https://doi.org/10.1109/TNNLS.2024.3405663

2024-06-05

Abstract:Benefiting from the high-temporal resolution of electroencephalogram (EEG), EEG-based emotion recognition has become one of the hotspots of affective computing. For EEG-based emotion recognition systems, it is crucial to utilize state-of-the-art learning strategies to automatically learn emotion-related brain cognitive patterns from emotional EEG signals, and the learned stable cognitive patterns effectively ensure the robustness of the emotion recognition system. In this work, to realize the efficient decoding of emotional EEG, we propose a graph learning system Graph Convolutional Network framework with Brain network initial inspiration and Fused attention mechanism (BF-GCN) inspired by the brain cognitive mechanism to automatically learn graph patterns from emotional EEG and improve the performance of EEG emotion recognition. In the proposed BF-GCN, three graph branches, i.e., cognition-inspired functional graph branch, data-driven graph branch, and fused common graph branch, are first elaborately designed to automatically learn emotional cognitive graph patterns from emotional EEG signals. And then, the attention mechanism is adopted to further capture the brain activation graph patterns that are related to emotion cognition to achieve an efficient representation of emotional EEG signals. Essentially, the proposed BF-CGN model is a cognition-inspired graph learning neural network model, which utilizes the spectral graph filtering theory in the automatic learning and extracting of emotional EEG graph patterns. To evaluate the performance of the BF-GCN graph learning system, we conducted subject-dependent and subject-independent experiments on two public datasets, i.e., SEED and SEED-IV. The proposed BF-GCN graph learning system has achieved 97.44% (SEED) and 89.55% (SEED-IV) in subject-dependent experiments, and the results in subject-independent experiments have achieved 92.72% (SEED) and 82.03% (SEED-IV), respectively. The state-of-the-art performance indicates that the proposed BF-GCN graph learning system has a robust performance in EEG-based emotion recognition, which provides a promising direction for affective computing.
EEG-Based Emotion Recognition Using Trainable Adjacency Relation Driven Graph Convolutional Network

Wei Li,Mingming Wang,Junyi Zhu,Aiguo Song

DOI: https://doi.org/10.1109/tcds.2023.3270170

IF: 4.546

2023-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:In recent years, there has been a growing research interest in using deep learning to resolve the issue of Electroencephalogram (EEG)-based emotion recognition. Current research emphasizes exploiting the useful information from each single EEG channel or each individual set of multi-channel EEG, but overlooks the correlation information among different multi-channel EEG sets. To explore such discriminative correlation information, we propose a novel and effective method“, Trainable Adjacency Relation Driven Graph Convolutional Network (TARDGCN)", which contains two complementary modules, TAR and GCN. TAR optimizes the local pair-wise positions of multi-channel EEG sets, which helps form an improved graphic representation for GCN to learn the global correlation among these sets for classification. The proposed method is capable of dealing with the problem of small sample size but large data variation in this issue. Our experimental results conducted on the databases DREAMER and DEAP in the subject-dependent and subject-independent modes show that TARDGCN outperforms the state-of-the-art approaches in classifying all of valence, arousal, and dominance.

robotics,computer science, artificial intelligence,neurosciences
Emotion Recognition Using Electrodermal Activity Signals and Multiscale Deep Convolution Neural Network

Nagarajan Ganapathy,Ramakrishnan Swaminathan

Abstract:Automated emotion recognition plays a vital role in problem solving, decision making and social activities of human life. An emotion is a set of reactions and experience to a given conditions, which are modeled as a linear combination of arousal and valence dimensions. Emotional pattern recognition based on physiological signals is a relatively new and fast growing area of research. Several physiological signals such as ECG, EEG, and EMG have been used for emotion recognition. Analysis of Electrodermal Activity (EDA) signals is one of the popular technique for emotion state analysis. In this work, an attempt is made to discriminate arousal-valence dimensions using EDA signals and multiscale one dimensional convolution neural network (MCNN). For this, EDA signals are obtained from publically available online DEAP database. These signals are normalized using channel normalization and subjected to MCNN for event-related robust features and classification. K-fold cross validation is used to investigate the performance of classifier. The result shows that the MCNN are able to discriminate the emotional states in arousal/valence dimensions. The proposed approach obtained an overall classification accuracy of 83.75% and 81.25% for arousal and valence scale, respectively. The network yields better classification performance for arousal scale then valence diemension. This might be due to the fact that arousal represent the intensity of emotions. The result also show that the proposed approach is better than the conventional hand-crafted feature based approach. Thus, it appears that the proposed approach can be used to differentiate autonomic and clinical conditions.
Emotion Recognition Using Dynamic Graph Metrics Based on Functional Integration and Separation of EEG Brain Network

Zhong-Min Wang,JiaWen Zhang,Chen Liang,Yan He,Jie Zhang

DOI: https://doi.org/10.2139/ssrn.4153708

2022-01-01

SSRN Electronic Journal

Abstract:The functional connection pattern of human brain in emotion processing is complex and changeable, and its complexity is mainly reflected in the dynamic changes of global and local structures.Using static global attributes to represent time-varying functional connections will lose important temporal and local information of EEG signals. Therefore, in order to study the dynamic changes of brain functional connectivity and the modular structure between different brain regions during the changes, more comprehensive metrics are needed to describe the time-varying brain topological features. In this paper, a dynamic graph metrics is proposed to describe time-varying brain topological features. Firstly, the brain connections in each time window were constructed into a brain functional network using Pearson correlation coefficient, and the modular structure of the brain network was obtained by Louvain algorithm. Then, the global features (average shortest path length, global efficiency) and local features (clustering coefficient, local efficiency, node degree) of individual modules are extracted based on the modular structure, and the time information is combined to form a three dimensional dynamic graph metrics. The results showed that the overall structure and modular structure of the brain network changed with time during the process of emotion change. Under positive emotion, the brain has strong global information processing ability, and has advantages in information integration and integration. Under negative emotion, the brain has strong local information processing ability, which has advantages in information separation and internal information processing. Finally, experiments are carried out on DEAP data set, and the highest accuracy of sentiment recognition using dynamic graph metrics is 87.67%.
Physiological Signals-based Emotion Recognition via High-order Correlation Learning

Junjie Zhu,Yuxuan Wei,Yifan Feng,Xibin Zhao,Yue Gao

DOI: https://doi.org/10.1145/3332374

2020-01-01

Abstract:Emotion recognition by physiological signals is an effective way to discern the inner state of human beings and therefore has been widely adopted in many user-centered applications. The majority of current state-of-the-art methods focus on exploring relationship among emotion and physiological signals. Given some particular features of the natural process of emotional expression, it is still a challenging and urgent issue to efficiently combine such high-order correlations among multimodal physiological signals and subjects. To tackle the problem, a novel multi-hypergraph neural networks is proposed, in which one hypergraph is established with one type of physiological signals to formulate inter-subject correlations. Each one of the vertices in a hypergraph stands for one subject with a description of its related stimuli, and the complex correlations among the vertices can be formulated through hyperedges. With the multi-hypergraph structure of the subjects, emotion recognition is translated into classification of vertices in the multi-hypergraph structure. Experimental results with the DEAP dataset and ASCERTAIN dataset demonstrate that the proposed method outperforms the current state-of-the-art methods.
MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition

Shuaiqi Liu,Xinrui Wang,Mingqi Jiang,Yanling An,Zhihui Gu,Bing Li,Yudong Zhang

DOI: https://doi.org/10.1016/j.knosys.2024.112599

IF: 8.139

2024-10-20

Knowledge-Based Systems

Abstract:In recent years, with the rise of deep learning technologies, EEG-based emotion recognition has garnered significant attention. However, most existing methods tend to focus on the spatiotemporal information of EEG signals while overlooking the potential topological information of brain regions. To address this issue, this paper proposes a dynamic graph attention network with multi-branch feature extraction and staged fusion (MAS-DGAT-Net), which integrates graph convolutional neural networks (GCN) for EEG emotion recognition. Specifically, the differential entropy (DE) features of EEG signals are first reconstructed into a correlation matrix using the Spearman correlation coefficient. Then, the brain-region connectivity-feature extraction (BCFE) module is employed to capture the brain connectivity features associated with emotional activation states. Meanwhile, this paper introduces a dual-branch cross-fusion feature extraction (CFFE) module, which consists of an attention-based cross-fusion feature extraction branch (A-CFFEB) and a cross-fusion feature extraction branch (CFFEB). A-CFFEB efficiently extracts key channel-frequency information from EEG features by using an attention mechanism and then fuses it with the output features from the BCFE. The fused features are subsequently input into the proposed dynamic graph attention module with a broad learning system (DGAT-BLS) to mine the brain connectivity feature information further. Finally, the deep features output by DGAT-BLS and CFFEB are combined for emotion classification. The proposed algorithm has been experimentally validated on SEED, SEED-IV, and DEAP datasets in subject-dependent and subject-independent settings, with the results confirming the model's effectiveness. The source code is publicly available at: https://github.com/cvmdsp/MAS-DGAT-Net

computer science, artificial intelligence
Emotion Recognition from Physiological Signals Using Multi-Hypergraph Neural Networks.

Junjie Zhu,Xibin Zhao,Han Hu,Yue Gao

DOI: https://doi.org/10.1109/icme.2019.00111

2019-01-01

Abstract:Emotion recognition from physiological signals is an effective way to discern the inner state of users. Existing works are lack in the exploration of latent correlation among multiple physiological signals and relationship among different subjects. To tackle this issue, we propose to recognize emotion from physiological signals using multi-hypergraph neural networks (MHGNN). In this method, the correlation among different subjects is formulated in the multi-hypergraph structure, where each type of physiological signal is used to generate one hypergraph. In each hypergraph, the hyperedges are used to represent the connections among the vertices (subject,stimuli). Thus, the emotion recognition task is modeled as classifying each vertex in the multi-hypergraph. Experimental results and comparisons with the state-of-the-art methods in the DEAP dataset demonstrate the superior performance of our method. The comparative experiments based on available biological knowledge verify that MHGNN can depict the real biological response process in a much more precise way.
Graph Convolutional Neural Network for EEG Emotion Recognition

Qi Li,Qingxiu Zhang,Tianqi Sui,Jie Liu,Yun Liu

DOI: https://doi.org/10.1109/ICFTIC57696.2022.10075315

2022-12-02

Abstract:Because emotion recognition is vital in improving human-computer interaction, emotion recognition is becoming increasingly critical in artificial intelligence. Deep learning is widely used to analyze frequency or time domain features in emotion recognition research. Few researchers consider the spatial features of Electroencephalogram (EEG) and the correlation between EEG channels. In this paper, the graph convolutional neural network is used to analyze the emotion of EEG signal. Firstly, the edge and point features of EEG were extracted to construct the graph structure, which made full use of the spatial and frequency features of EEG. Then, the time-series information of EEG was extracted and classified by using the long short-term memory neural network. In the DEAP dataset, the accuracy of the proposed method in the valence and arousal dimension are 83.23% and 85.82%, respectively. The research can be applied to the emotional brain computer interface system.

Medicine,Computer Science
Emotion Detection from EEG Signals Using Machine Deep Learning Models

João Vitor Marques Rabelo Fernandes,Auzuir Ripardo de Alexandria,João Alexandre Lobo Marques,Débora Ferreira de Assis,Pedro Crosara Motta,Bruno Riccelli Dos Santos Silva

DOI: https://doi.org/10.3390/bioengineering11080782

2024-08-02

Abstract:Detecting emotions is a growing field aiming to comprehend and interpret human emotions from various data sources, including text, voice, and physiological signals. Electroencephalogram (EEG) is a unique and promising approach among these sources. EEG is a non-invasive monitoring technique that records the brain's electrical activity through electrodes placed on the scalp's surface. It is used in clinical and research contexts to explore how the human brain responds to emotions and cognitive stimuli. Recently, its use has gained interest in real-time emotion detection, offering a direct approach independent of facial expressions or voice. This is particularly useful in resource-limited scenarios, such as brain-computer interfaces supporting mental health. The objective of this work is to evaluate the classification of emotions (positive, negative, and neutral) in EEG signals using machine learning and deep learning, focusing on Graph Convolutional Neural Networks (GCNN), based on the analysis of critical attributes of the EEG signal (Differential Entropy (DE), Power Spectral Density (PSD), Differential Asymmetry (DASM), Rational Asymmetry (RASM), Asymmetry (ASM), Differential Causality (DCAU)). The electroencephalography dataset used in the research was the public SEED dataset (SJTU Emotion EEG Dataset), obtained through auditory and visual stimuli in segments from Chinese emotional movies. The experiment employed to evaluate the model results was "subject-dependent". In this method, the Deep Neural Network (DNN) achieved an accuracy of 86.08%, surpassing SVM, albeit with significant processing time due to the optimization characteristics inherent to the algorithm. The GCNN algorithm achieved an average accuracy of 89.97% in the subject-dependent experiment. This work contributes to emotion detection in EEG, emphasizing the effectiveness of different models and underscoring the importance of selecting appropriate features and the ethical use of these technologies in practical applications. The GCNN emerges as the most promising methodology for future research.
End-to-End Emotion Recognition using Peripheral Physiological Signals

M. Pidgeon,N. Kanwal,N. Murray,M. Asghar

DOI: https://doi.org/10.14236/ewic/hci2022.19

2022-07-01

Abstract:The study of emotion recognition from physiological signals has seen a huge growth in recent decades. Studies initially used traditional machine learning classiﬁcation to estimate either discrete emotions or combinations of arousal and valence. However, different feature engineering techniques such as Ensemble Empirical Mode Decomposition (EEMD) Analysis for electroencephalography (EEG) signals and statistical calculations for peripheral signals are used prior to machine learning. Also, several sensors needed to be worn by participants to predict the emotions. This study aims to investigate whether arousal and valence can be predicted from a single peripheral signal using deep learning. The Galvanic Skin Response(GSR), Respiration (RSP), Blood Volume Pulse (BVP) and Temperature (Temp) signals from the DEAP dataset are used. The signals are downsampled to approximately three hertz (Hz) and input to a convolutional network (CNN) to predict arousal and valence. GSR, RSP and BVP had similar F1 and accuracy results. BVP had an F1 result of 0.673 and 0.632 and accuracies of 63.5% and 61.1% respectively for arousal and valence. RSP’s F1 results were 0.677 and 0.669 and accuracies were 61.3% and 64.2% for arousal and valence respectively. GSR had F1 results of 0.699 and 0.663 and accuracies of 62.5% and 60.2% respectively for arousal and valence. Using raw signals and examining the peripheral signals individually, we were able to identify which sensors showed the best potential for further research to bring emotion classiﬁcation into a real-world scenario using non-invasive sensors.

Computer Science
DC-ASTGCN: EEG Emotion Recognition Based on Fusion Deep Convolutional and Adaptive Spatio-temporal Graph Convolutional Networks

Xiaodong Yang,Zhengping Zhu,Guangkang Jiang,Dandan Wu,Aijun He,Jun Wang

DOI: https://doi.org/10.1109/JBHI.2024.3449083

2024-09-05

Abstract:Thanks to advancements in artificial intelligence and brain-computer interface (BCI) research, there has been increasing attention towards emotion recognition techniques based on electro encephalogram (EEG) recently. The complexity of EEG data poses a challenge when it comes to accurately classifying emotions by integrating time, frequency, and spatial domain features. To address this challenge, this paper proposes a fusion model called DC-ASTGCN, which combines the strengths of deep convolutional neural network (DCNN) and adaptive spatiotemporal graphic convolutional neural network (ASTGCN) to comprehensively analyze and understand EEG signals. The DCNN focuses on extracting frequency-domain and local spatial features from EEG signals to identify brain region activity patterns, while the ASTGCN, with its spatiotemporal attention mechanism and adaptive brain topology layer, reveals the functional connectivity features between brain regions in different emotional states. This integration significantly enhances the model's ability to understand and recognize emotional states. Extensive experiments conducted on the DEAP and SEED datasets demonstrate that the DC-ASTGCN model outperforms existing state-of the-art methods in terms of emotion recognition accuracy.
Exploring non-Euclidean relationships in EEG emotion recognition: A dynamic graph attention network

Rongrong Fu,Mengpu Cai,Shiwei Wang,Yaodong Wang,Chengcheng Jia

DOI: https://doi.org/10.1016/j.bspc.2024.106276

IF: 5.1

2024-03-27

Biomedical Signal Processing and Control

Abstract:Deep learning classification models based on electroencephalogram (EEG) emotion recognition have demonstrated considerable proficiency in the categorization of emotional states. However, these models have limitations in their capability to analyze the active states and cooperative relationships among distinct brain regions. This study proposes a dynamic graph attention network (DGAT) for EEG emotion recognition, which learns the features of each channel and leverages multiple-head self-attention mechanisms to capture non-Euclidean relationships between channels. Then, we use differential entropy features of emotions signals on the SJTU emotion EEG dataset (SEED). The DGAT model achieved improved subject-dependent and cross-subject classification accuracy compared to previous models. Moreover, ablation studies show that the channel weight matrix(CWM) and appropriate hyper-parameters can improve the performance of the DGAT model significantly. Furthermore, by conducting interpretable analysis of the new connections and electrode weights learned by the model, we find that these connection weight relationships reflect a certain degree of coordination within the brain for EEG-based emotion recognition. These findings provide a new method for EEG emotion recognition and highlights the potential for using deep learning models to analyze the active state and synergistic relationships among brain regions.

engineering, biomedical

LY 503430 , a novel AMPA receptor potentiator with functional , neuroprotective and neurotrophic effects in rodent models of Parkinson ’ s disease

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Attention-based Temporal Graph Representation Learning for EEG-based Emotion Recognition

EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM

EEG-Based Emotion Recognition Using Partial Directed Coherence Dense Graph Propagation

EDA-Graph: Graph Signal Processing of Electrodermal Activity for Emotional States Detection

Spatial-temporal features-based EEG emotion recognition using graph convolution network and long short-term memory

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Emotion Recognition By Edge-Weighted Hypergraph Neural Network

An Efficient Graph Learning System for Emotion Recognition Inspired by the Cognitive Prior Graph of EEG Brain Network

EEG-Based Emotion Recognition Using Trainable Adjacency Relation Driven Graph Convolutional Network

Emotion Recognition Using Electrodermal Activity Signals and Multiscale Deep Convolution Neural Network

Emotion Recognition Using Dynamic Graph Metrics Based on Functional Integration and Separation of EEG Brain Network

Physiological Signals-based Emotion Recognition via High-order Correlation Learning

MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition

Emotion Recognition from Physiological Signals Using Multi-Hypergraph Neural Networks.

Graph Convolutional Neural Network for EEG Emotion Recognition

Emotion Detection from EEG Signals Using Machine Deep Learning Models

End-to-End Emotion Recognition using Peripheral Physiological Signals

DC-ASTGCN: EEG Emotion Recognition Based on Fusion Deep Convolutional and Adaptive Spatio-temporal Graph Convolutional Networks

Exploring non-Euclidean relationships in EEG emotion recognition: A dynamic graph attention network