Research on SSVEPs in Correlational Convolutional Neural Networks Based on Filter Banks

Dan Han,Yanqing Dong,Xin Wen,Chengxin Gao,Ruochen Cao,Yuxiang Guo,Jie Xiang,rui cao
DOI: https://doi.org/10.2139/ssrn.4356352
2023-01-01
Abstract:Currently, in the field of steady-state visual evoked potential brain computer interfaces (SSVEPs-BCIs) research, convolutional neural networks (CNNs) have gradually been proved to be an effective method. Whereas, most networks use the frequency domain characteristics in long time windows as the network input, resulting in low performance in short time windows. Furthermore, most networks use only the frequency domain information for classification, which causes the loss of other task-related information. Hence, this paper proposes a time-frequency domain generalized filter bank convolutional network (FBCNN-G) to improve the SSVEPs-BCIs classification performance. The network input includes the training dataset, a single template dataset and the predefined prior data of sine-cosine signals. The three datasets are input into different networks for feature extraction, and correlation analyses of the three datasets are performed at the end of the network. The network architecture can effectively extract task-related features, improving the performance. In addition, the method proposes the use of filter banks divided into specific frequency bands as pre-filters in the network to fully consider the fundamental and harmonic frequency characteristics of the signal. The proposed FBCNN-G model is compared with other methods on the public dataset Bench. The results manifest that this model has higher accuracy of character recognition accuracy and information transfer rates in several time windows. Particularly, in the 0.2 s time window, the mean precision of the proposed method reaches 62.02±5.12% on Bench, showing its superior performance. Therefore, the proposed FBCNN-G model is critical for the exploitation of SSVEPs-BCIs character recognition models.
What problem does this paper attempt to address?