A Real-Time CNN-BiLSTM-based Classifier for Patient-Centered AR-SSVEP Active Rehabilitation Exoskeleton System

Zida An,Fei Wang,Yongzhao Wen,Fangzhou Hu,Shuai Han
DOI: https://doi.org/10.1016/j.eswa.2024.124706
IF: 8.5
2024-01-01
Expert Systems with Applications
Abstract:The rehabilitation of stroke has brought a serious social burden to many countries. The augmented reality steady-state visually evoked potential (AR-SSVEP) exoskeleton rehabilitation system can effectively help stroke patients recover motor function and reduce the burden on society and rehabilitation physicians. However, the decoding accuracy and efficiency of AR-SSVEP in short time stimulus are low, and the types of trajectory decoded are few. It has a negative impact on the patient's rehabilitation interest and efficiency. In this article, a patient-centered AR-SSVEP active rehabilitation exoskeleton system is developed based on the CNN-BiLSTM fast classification algorithm. The algorithm uses CNN architecture to improve model generalization, and uses BiLSTM to improve classification accuracy. The patient-centered interactive trajectory decoding logic based on a task-driven strategy is proposed to achieve patient-defined coordinated movement trajectory of the left and right upper limb shoulder elbow joints through the 6-class brain-computer interface (BCI). The offline and online experiments were conducted on the system. In offline experiments, under a 0.5 s time window, the classification accuracy rate was 98.5%, and the information transfer rate (ITR) reached 210 bits/min. In online experiment, the patient controlled the exoskeleton of the upper limb to perform four non-repetitive trajectories, with an average time of 319 s, which was 20% more than the standard reference time. The experimental results have shown the system can effectively improve the accuracy and efficiency of motion intention identification within short time stimulus, and decode patient-defined motion trajectory. In conclusion, this study will provide a new rehabilitation way for stroke patients.
What problem does this paper attempt to address?