Attention with kernels for EEG-based emotion classification

Dongyang Kuang,Craig Michoski
DOI: https://doi.org/10.1007/s00521-023-09344-9
2023-12-29
Neural Computing and Applications
Abstract:A kernel attention module (KAM) is presented for the task of EEG-based emotion classification using neural network based models. In this study, it is shown that the KAM method can lead to more efficient and accurate models using only a single parameter design. This additional parameter can be leveraged as an interpretable scalar quantity for examining the overall amount of attention needed during deep feature refinement. Extensive experiments are analyzed on both the SEED and DEAP datasets to demonstrate the module's performance on subject-dependent classification tasks. From these benchmark studies, it is shown that KAM is able to boost the backbone model's mean prediction accuracy by more than 3% on some subjects and up to more than 1%, on average, across 15 subjects in the SEED dataset for subject dependent tasks. In the DEAP dataset, the improvement is more significant by achieving greater than 3% improvement in the overall mean accuracy versus the no-attention case, and more than 1–2% when benchmarked against various other state-of-the-art attention modules. In addition, the predictive dependencies of KAM with respect to its single parameter is numerically examined up to first order. Accompanying analyzes and visualization techniques are also proposed for interpreting the KAM attention module's effects, and interaction with the backbone model's predictive behaviors. These quantitative results can be explored in greater depth to identify correlations with pertinent clinical neuroscientific observations. Finally, a formal mathematical proof of KAM's permutation equivariance property is included.
computer science, artificial intelligence
What problem does this paper attempt to address?