Measuring Decision Confidence Levels from EEG Using a Spectral-Spatial-Temporal Adaptive Graph Convolutional Neural Network.

Rui Li,Yiting Wang,Bao-Liang Lu
DOI: https://doi.org/10.1007/978-981-99-1642-9_34
2022-01-01
Abstract:Decision confidence can reflect the correctness of people’s decisions to some extent. To measure the reliability of human decisions in an objective way, we introduce a spectral-spatial-temporal adaptive graph convolutional neural network (SST-AGCN) for recognizing decision confidence levels based on EEG signals in this paper. The advantage of our proposed method is that it fully utilizes the knowledge from the spectral, spatial, and temporal dimensions of the EEG signals. The experiments based on a confidence text exam task within limited time are designed and conducted. The experimental results demonstrate that the SST-AGCN enhances the performance compared with the models without using the spatial or temporal information for classifying five decision confidence levels, achieving the average F1-score of 57.92% and the average accuracy of 58.16%. As for the two extreme confidence levels, the average F1-score reaches to 93.17% with the average accuracy of 94.11%. Furthermore, the neural patterns of decision confidence are analyzed in this paper through the brain topographic maps and the learned functional connectivities by the SST-AGCN. The experimental results indicate that the delta, theta and alpha bands may be critical in measuring human decision confidence levels with better recognition performance than other frequency bands.
What problem does this paper attempt to address?