Decoding SSVEP Via Calibration-Free TFA-Net: A Novel Network Using Time-Frequency Features

Lei Xu,Xinyi Jiang,Ruimin Wang,Pan Lin,Yuankui Yang,Yue Leng,Wenming Zheng,Sheng Ge
DOI: https://doi.org/10.1109/jbhi.2024.3510740
IF: 7.7
2024-01-01
IEEE Journal of Biomedical and Health Informatics
Abstract:Brain-computer interfaces (BCIs) based on steady-state visual evoked potential (SSVEP) signals offer high information transfer rates and non-invasive brain-to-device connectivity, making them highly practical. In recent years, deep learning techniques, particularly convolutional neural network (CNN) architectures, have gained prominence in EEG (e.g., SSVEP) decoding because of their nonlinear modeling capabilities and autonomy from manual feature extraction. However, most studies using CNNs employ temporal signals as the input and cannot directly mine the implicit frequency information, which may cause crucial frequency details to be lost and challenges in decoding. By contrast, the prevailing supervised recognition algorithms rely on a lengthy calibration phase to enhance algorithm performance, which could impede the popularization of SSVEP based BCIs. To address these problems, this study proposes the Time-Frequency Attention Network (TFA-Net), a novel CNN model tailored for SSVEP signal decoding without the calibration phase. Additionally, we introduce the Frequency Attention and Channel Recombination modules to enhance ability of TFA-Net to infer finer frequency- wise attention and extract features efficiently from SSVEP in the time-frequency domain. Classification results on a public dataset demonstrated that the proposed TFA-Net outperforms all the compared models, achieving an accuracy of 79.00% $\pm$ 0.27% and information transfer rate of 138.82 $\pm$ 0.78 bits/min with a 1-s data length. TFA-Net represents a novel approach to SSVEP identification as well as time-frequency signal analysis, offering a calibration-free solution that enhances the generalizability and practicality of SSVEP based BCIs.
What problem does this paper attempt to address?