Mental workload estimation with electroencephalogram signals by combining multi-space deep models
Hong-Hai Nguyen,Ngumimi Karen Iyortsuun,Seungwon Kim,Hyung-Jeong Yang,Soo-Hyung Kim
DOI: https://doi.org/10.1016/j.bspc.2024.106284
IF: 5.1
2024-04-03
Biomedical Signal Processing and Control
Abstract:The human brain is perpetually active, operating during both work and rest. Excessive mental activity, termed overload, can detrimentally impact health. Advances in predicting mental health conditions aim to prevent severe consequences and improve overall well-being. Consequently, mental status estimation has gained considerable research attention due to its potential benefits. Among the various signals used to assess mental state, the electroencephalogram, with its wealth of brain-related information, is widely employed by researchers. In this paper, we categorize mental workload into three states (low, middle, and high) and estimate a continuum of mental workload levels. Our method leverages information from multiple spatial dimensions (time and frequency domain) to achieve optimal results. In our approach, focusing on the time domain, we utilize Temporal Convolutional Networks to capture temporal information. Meanwhile, in the frequency domain, we implement two distinct branches aimed at acquiring varied information regarding Power Spectral Density by utilizing different lengths of the Fast Fourier Transform. Each branch consists of two blocks, known as the Multi-Dimensional Residual Block, representing a novel architecture by combining residual blocks. The integration of these two domains yields significant results compared to individual estimates in each domain. Our approach achieved a 74.98% accuracy in the three-class classification, surpassing the provided data results at 69.00%. Specially, our method demonstrates efficacy in estimating continuous levels, evidenced by a corresponding Concordance Correlation Coefficient result of 0.629. The combination of time and frequency domain analysis in our approach highlights the exciting potential to improve healthcare applications in the future.
engineering, biomedical