Application of a multi-source multi-task weight adaptation framework for cross-domain EEG emotion recognition(MS-MWA)
Yijun Zhu,Yuliang Ma,Ming Meng,Zhizeng Luo,Yunyuan Gao,Mingxu Sun
DOI: https://doi.org/10.1007/s11760-024-03533-2
IF: 1.583
2024-11-06
Signal Image and Video Processing
Abstract:In the practical implementation of the Electroencephalography (EEG) emotion recognition system, the development of a universal model applicable to different subjects and sessions is crucial. Previous studies have primarily focused on employing domain adaptation methods to address the differences in EEG distributions between different subjects and sessions. However, traditional approaches overly rely on source domain data, resulting in sensitivity to changes and limited generalization and adaptability. The introduction of multi-task domain adaptation, through diverse training, enhances generalization, making the model more flexible and adaptable to the complex and dynamic nature of real-world environments. Therefore, we propose a Multi-Source Multi-Task Weight Adaptation Framework (MS-MWA). To enhance model generalization, we introduce multiple tasks at different levels, enabling the model to learn hierarchical feature representations. At shallow layers, the model learns domain-invariant features, while at deep layers, it learns domain-specific features, thereby improving the model's understanding of complex abstractions. To address the challenge of difficulty in adjusting relative weights among various task losses, we propose a multi-task deep learning approach that balances different loss functions using homoscedastic uncertainty between tasks, which dynamically assigns weights based on their relative uncertainty. Tasks with higher uncertainty receive lower weights, reducing their influence on the overall loss, while tasks with lower uncertainty receive higher weights, increasing their influence. This method not only reduces the need for continual adjustment of weights for optimal performance but also enhances overall model performance. We evaluated our proposed model on the publicly available datasets SEED and SEED-IV. In cross-subject experiments, our model achieved accuracy rates of 91.36% and 72.25% on SEED and SEED-IV, respectively. In cross-session experiments, our model demonstrated accuracy rates of 92.16% on SEED and 77.47% on SEED-IV.
engineering, electrical & electronic,imaging science & photographic technology