EEG-Based Mental Imagery Task Adaptation via Ensemble of Weight-Decomposed Low-Rank Adapters

Taveena Lotey,Aman Verma,Partha Pratim Roy
DOI: https://doi.org/10.1007/978-3-031-78195-7_21
2024-12-08
Abstract:Electroencephalography (EEG) is widely researched for neural decoding in Brain Computer Interfaces (BCIs) as it is non-invasive, portable, and economical. However, EEG signals suffer from inter- and intra-subject variability, leading to poor performance. Recent technological advancements have led to deep learning (DL) models that have achieved high performance in various fields. However, such large models are compute- and resource-intensive and are a bottleneck for real-time neural decoding. Data distribution shift can be handled with the help of domain adaptation techniques of transfer learning (fine-tuning) and adversarial training that requires model parameter updates according to the target domain. One such recent technique is Parameter-efficient fine-tuning (PEFT), which requires only a small fraction of the total trainable parameters compared to fine-tuning the whole model. Therefore, we explored PEFT methods for adapting EEG-based mental imagery tasks. We considered two mental imagery tasks: speech imagery and motor imagery, as both of these tasks are instrumental in post-stroke neuro-rehabilitation. We proposed a novel ensemble of weight-decomposed low-rank adaptation methods, EDoRA, for parameter-efficient mental imagery task adaptation through EEG signal classification. The performance of the proposed PEFT method is validated on two publicly available datasets, one speech imagery, and the other motor imagery dataset. In extensive experiments and analysis, the proposed method has performed better than full fine-tune and state-of-the-art PEFT methods for mental imagery EEG classification.
Signal Processing,Machine Learning
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the problem of poor EEG signal classification performance in electroencephalogram (EEG) - based brain - computer interfaces (BCIs) due to inter - individual and intra - individual differences. Specifically, the paper focuses on how to improve the classification performance of EEG signals in mental imagery tasks through parameter - efficient fine - tuning (PEFT) methods, especially for speech imagery (SI) and motor imagery (MI) tasks. #### Main problems: 1. **Inter - individual and intra - individual differences in EEG signals**: EEG signals are easily affected by individual differences, resulting in unstable performance of the model on different individuals or at different time periods of the same individual. 2. **Computational resource requirements of deep - learning models**: Although traditional deep - learning models perform well in many fields, they usually have a large number of parameters and high computational complexity, making it difficult to achieve real - time neural decoding. 3. **Domain adaptation problem**: When the data distribution changes (for example, from one individual to another), effective domain adaptation techniques are required to reduce the impact of this distribution change on the model performance. #### Proposed solutions: - **Parameter - efficient fine - tuning (PEFT)**: By introducing methods such as low - rank adapters, only a small number of parameters are updated, thereby achieving efficient and low - resource - consuming model fine - tuning. - **EDoRA method**: A novel method of ensemble of weight - decomposed low - rank adapters (EDoRA) is proposed to improve the classification performance of EEG signals in mental imagery tasks. - **Cross - task adaptation**: It has been verified that the pre - trained model parameters of one mental imagery task are used for the fine - tuning of another mental imagery task, and good results have been achieved. Through these methods, the paper hopes to significantly reduce the computational resource requirements while maintaining high performance, making EEG signal classification more suitable for practical applications, especially in rehabilitation treatment in the field of brain - computer interfaces.