A review on evaluating mental stress by deep learning using EEG signals

Yara Badr,Usman Tariq,Fares Al-Shargie,Fabio Babiloni,Fadwa Al Mughairbi,Hasan Al-Nashash
DOI: https://doi.org/10.1007/s00521-024-09809-5
2024-05-11
Neural Computing and Applications
Abstract:Mental stress is a common problem that affects individuals all over the world. Stress reduces human functionality during routine work and may lead to severe health defects. Early detection of stress is important for preventing diseases and other negative health-related consequences of stress. Several neuroimaging techniques have been utilized to assess mental stress, however, due to its ease of use, robustness, and non-invasiveness, electroencephalography (EEG) is commonly used. This paper aims to fill a knowledge gap by reviewing the different EEG-related deep learning algorithms with a focus on Convolutional Neural Networks (CNNs) and Long Short-Term Memory networks (LSTMs) for the evaluation of mental stress. The review focuses on data representation, individual deep neural network model architectures, hybrid models, and results amongst others. The contributions of the paper address important issues such as data representation and model architectures. Out of all reviewed papers, 67% used CNN, 9% LSTM, and 24% hybrid models. Based on the reviewed literature, we found that dataset size and different representations contributed to the performance of the proposed networks. Raw EEG data produced classification accuracy around 62% while using spectral and topographical representation produced up to 88%. Nevertheless, the roles of generalizability across different deep learning models and individual differences remain key areas of inquiry. The review encourages the exploration of innovative avenues, such as EEG data image representations concurrently with graph convolutional neural networks (GCN), to mitigate the impact of inter-subject variability. This novel approach not only allows us to harmonize structural nuances within the data but also facilitates the integration of temporal dynamics, thereby enabling a more comprehensive assessment of mental stress levels.
computer science, artificial intelligence
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to evaluate mental stress from electroencephalogram (EEG) signals by using deep - learning techniques, especially convolutional neural networks (CNNs) and long - short - term memory networks (LSTMs). Specifically, the paper aims to fill the knowledge gap by reviewing different EEG - related deep - learning algorithms, with a focus on the application of CNNs and LSTMs in mental stress assessment. The paper also explores aspects such as data representation, individual deep neural network model architectures, hybrid models, and results. The paper emphasizes the importance of data representation and model architecture, and points out that among all the reviewed literatures, 67% used CNN, 9% used LSTM, and 24% used hybrid models. The study found that the size of the data set and different representation methods have a significant impact on the performance of the proposed network. The classification accuracy of the original EEG data is approximately 62%, while using spectral and topographic map representations can achieve an accuracy of up to 88%. However, the generalization ability and individual differences between different deep - learning models remain key research areas. In addition, the paper encourages the exploration of innovative approaches, such as using EEG data image representation and graph convolutional neural networks (GCN) simultaneously, to reduce the impact of cross - individual variation. This novel method not only allows us to reconcile the structural nuances in the data, but also promotes the integration of time dynamics, thereby achieving a more comprehensive assessment of mental stress levels. In summary, this paper mainly solves the problem of how to effectively evaluate mental stress from EEG signals by using deep - learning techniques, especially CNNs and LSTMs, and proposes directions for future research.