A new method for classifying complex filiform Lie algebras

L. Boza,E. M. Fedriani,J. Núñez

DOI: https://doi.org/10.1016/S0096-3003(99)00270-2

IF: 4.397

2001-06-15

Applied Mathematics and Computation

Abstract:

What problem does this paper attempt to address?

Machine Learning for Multi-Action Classification of Lower Limbs for BCI

Zilu Wang,Jichun Li,Ian Daly,Junhua Li

DOI: https://doi.org/10.1109/iccece55162.2022.9875092

2022-01-01

Abstract:Over the past two decades, significant progress has been made in brain-computer interfaces (BCIs), devices which enable direct communications between human brains and external devices. One of the prevalent control paradigms is motor imagery-based BCI (MI-BCI), by which users imagine specific actions to express their intentions. Left-hand and right-hand motor imageries are frequently used in the MI-BCI. If a third class is needed, the imagination of both feet is usually added. However, it is relatively rare to separate feet into left lower limb and right limb in MI-BCI systems. In addition, previous studies have demonstrated that real movements can be distinguished from one another via processing the electroencephalogram (EEG). Similarly, motor imagery (MI) and movement observations (MO) can also be distinguished from one another. However, classification of left lower limb actions and right lower limb actions between MI, Real Movement (RM), and MO actions, has not been thoroughly explored. To address these questions, we performed a comprehensive experiment to collect EEG under six actions (i.e., Left-MI, Right-MI, Left-RM, Right-RM, Left-MO, and Right-MO) and used three models (convolutional neural network [CNN], support vector machine [SVM], and a K-Nearest Neighbours [KNN]) to classify these actions. Our CNN achieved the highest performance (37.77%) in the classification of six actions. Although the performance of SVM (37.21%) and KNN (25.26%) was worse, it is still better than the chance level (16.67%). Our results suggest that it is possible to distinguish between these six lower limb actions. This study has implications for developing multi-class BCI systems and promoting the research of multiple-action classification.
Motor Imagery Classification Based on Deep Convolutional Neural Network and Its Application in Exoskeleton Controlled by EEG

Zhi-Chuan TANG,Ke-Jun ZHANG,Chao LI,Shou-Qian SUN,Qi HUANG,San-Yuan ZHANG

DOI: https://doi.org/10.11897/SP.J.1016.2017.01367

2017-01-01

Abstract:Brain-Computer Interface (BCI) based on motor imagery (MI) has been applied in the rehabilitation exoskeleton widely.In the practical use,the low signal-noise ratio of electroencephalogram (EEG) signal results in the low classification accuracy in BCI.Therefore,many studies have focused on the improvement of feature extraction and classification algorithms.In this paper,we proposed an original method based on the deep convolutional neural network (CNN) to perform feature extraction and classification for single-trial MI EEG signal.Firstly,according to the EEG signal''s characteristic that combining time and space information,we constructed a 5-layer CNN model to classify the MI;secondly,MI experimental paradigm was designed based on imagining left hand movement and foot movement,and the experimental data of MI were collected;thirdly,the proposed method was used in the public data set and experimental data set to build classification model,compared with the other three methods (power+SVM,CSP+SVM and MRA+LDA);finally,the classification model which achieved the best classification performance was applied in real-time control of upper-limb exoskeleton to verify the effectiveness of our proposed method.The results demonstrate that CNN can further improve classification performance: the average accuracies of public data set (90.75%±2.47%) and experimental data set (89.51%±2.95%) using CNN are both higher than that using the other three methods.Furthermore,in real-time control of upper-limb exoskeleton,the average accuracy of all subjects reaches to 88.75%±3.42%,which verifies the effectiveness of the CNN method.The proposed method can recognize MI,and provides theoretical basis and technical support for BCI applications in the field of rehabilitation exoskeleton.
A transfer learning-based CNN and LSTM hybrid deep learning model to classify motor imagery EEG signals

Zahra Khademi,Farideh Ebrahimi,Hussain Montazery Kordy

DOI: https://doi.org/10.1016/j.compbiomed.2022.105288

Abstract:In the Motor Imagery (MI)-based Brain Computer Interface (BCI), users' intention is converted into a control signal through processing a specific pattern in brain signals reflecting motor characteristics. There are such restrictions as the limited size of the existing datasets and low signal to noise ratio in the classification of MI Electroencephalogram (EEG) signals. Machine learning (ML) methods, particularly Deep Learning (DL), have overcome these limitations relatively. In this study, three hybrid models were proposed to classify the EEG signal in the MI-based BCI. The proposed hybrid models consist of the convolutional neural networks (CNN) and the Long-Short Term Memory (LSTM). In the first model, the CNN with different number of convolutional-pooling blocks (from shallow to deep CNN) was examined; a two-block CNN model not affected by the vanishing gradient descent and yet able to extract desirable features employed; the second and third models contained pre-trained CNNs conducing to the exploration of more complex features. The transfer learning strategy and data augmentation methods were applied to overcome the limited size of the datasets by transferring learning from one model to another. This was achieved by employing two powerful pre-trained convolutional neural networks namely ResNet-50 and Inception-v3. The continuous wavelet transform (CWT) was used to generate images for the CNN. The performance of the proposed models was evaluated on the BCI Competition IV dataset 2a. The mean accuracy vlaues of 86%, 90%, and 92%, and mean Kappa values of 81%, 86%, and 88% were obtained for the hybrid neural network with the customized CNN, the hybrid neural network with ResNet-50 and the hybrid neural network with Inception-v3, respectively. Despite the promising performance of the three proposed models, the hybrid neural network with Inception-v3 outperformed the two other models. The best obtained result in the present study improved the previous best result in the literature by 7% in terms of classification accuracy. From the findings, it can be concluded that transfer learning based on a pre-trained CNN in combination with LSTM is a novel method in MI-based BCI. The study also has implications for the discrimination of motor imagery tasks in each EEG recording channel and in different brain regions which can reduce computational time in future works by only selecting the most effective channels.
A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation

Lin Yao,Xinjun Sheng,Dingguo Zhang,Ning Jiang,Natalie Mrachacz-Kersting,Xiangyang Zhu,Dario Farina

DOI: https://doi.org/10.1109/tnsre.2017.2684084

IF: 4.9

2017-01-01

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Distinctive EEG signals from the motor and somatosensory cortex are generated during mental tasks of motor imagery (MI) and somatosensory attentional orientation (SAO). In this paper, we hypothesize that a combination of these two signal modalities provides improvements in a brain–computer interface (BCI) performance with respect to using the two methods separately, and generate novel types of multi-class BCI systems. Thirty two subjects were randomly divided into a Control-Group and a Hybrid-Group. In the Control-Group, the subjects performed left and right hand motor imagery (i.e., L-MI and R-MI). In the Hybrid-Group, the subjects performed the four mental tasks (i.e., L-MI, R-MI, L-SAO, and R-SAO). The results indicate that combining two of the tasks in a hybrid manner (such as L-SAO and R-MI) resulted in a significantly greater classification accuracy than when using two MI tasks. The hybrid modality reached 86.1% classification accuracy on average, with a 7.70% increase with respect to MI ( ${\mathrm {P}}<0.01$ ), and 7.21% to SAO ( ${\mathrm {P}}<0.01$ ) alone. Moreover, all 16 subjects in the hybrid modality reached at least 70% accuracy, which is considered the threshold for BCI illiteracy. In addition to the two-class results, the classification accuracy was 68.1% and 54.1% for the three-class and four-class hybrid BCI. Combining the induced brain signals from motor and somatosensory cortex, the proposed stimulus-independent hybrid BCI has shown improved performance with respect to individual modalities, reducing the portion of BCI-illiterate subjects, and provided novel types of multi-class BCIs.
Classification of EEG signals related to real and imagery knee movements using deep learning for brain computer interfaces

Yeji Lee,Hyun Ju Lee,Ki Sik Tae

DOI: https://doi.org/10.3233/THC-220363

Abstract:Background: Non-invasive Brain-Computer Interface (BCI) uses an electroencephalogram (EEG) to obtain information on brain neural activity. Because EEG can be contaminated by various artifacts during the collection process, it has primarily evolved into motor imagery (MI) with a low risk of contamination. However, MI has a disadvantage in that accurate data is difficult to obtain. Objective: The goal of this study was to determine which motor imagery and movement execution (ME) of the knee has the best classification performance. Methods: Ten subjects were selected to provide MI and ME data for four different types of knee exercise. The experiment was conducted to keep the left, right, and both knees extend or bend for five seconds, and there was a five seconds break between each movement. Each motion was performed 20 times and the MI was carried out in the same protocol. Motions were classified through a modified model of the Lenet-5 of CNN (Convolution Neural Network). Results: The deep learning data was classified, and a study discovered that ME (98.91%) could be classified significantly more accurately than MI (98.37%) (p< 0.001). Conclusion: If future studies on other body movements are conducted, we anticipate that BCI can be further developed to be more accurate. And such advancements in BCI can be used to facilitate the patient's communication by analyzing the user's movement intention. These results can also be used for various controls such as robots using a combination of MI and ME.
Enhance Decoding of Functional Lower-Limb Movements by Combining Sensory Motor Rhythm and Movement-Related Cortical Potential Features

Yulong Peng,Chenyang Li,Xuchao Chen,Xiaomeng Miao,Shaomin Zhang

DOI: https://doi.org/10.1145/3563737.3563756

2022-01-01

Abstract:In previous studies, Sensory Motor Rhythm (SMR) and Movement-Related Cortical Potential (MRCP) have been proved to be complementary in decoding a variety of motion information. However, no studies have reported whether they are complementary when subjects perform functional lower limb movements. In this work, we investigate the effect of two features or their combination on classifying three functional lower limb movements (standing, walking, sitting) and rest. MRCP features are extracted by Locality Preserving Projection (LPP) and SMR features are extracted by selecting the best frequency-channel pairs through the Bhattacharyya distance. A Support Vector Machine (SVM) classifier was employed to assess the performance of different features or their combination in six binary classification tasks, where three types of lower limb movements are compared with each other or with rest. The combination of two features achieved the highest accuracy in most classification task. In the classification of standing and walking, the combination of these two features has shown significantly better performance (both p < 0.05) than the classifiers using either MRCP or SMR. Our results suggest that MRCP and SMR features are complementary for decoding the functional lower limb movements, which would benefit the Brain-computer Interface (BCI) system for lower limb rehabilitation.
An in-depth survey on Deep Learning-based Motor Imagery Electroencephalogram (EEG) classification

Xianheng Wang,Veronica Liesaputra,Zhaobin Liu,Yi Wang,Zhiyi Huang

DOI: https://doi.org/10.1016/j.artmed.2023.102738

IF: 7.011

2023-12-04

Artificial Intelligence in Medicine

Abstract:Electroencephalogram (EEG)-based Brain-Computer Interfaces (BCIs) build a communication path between human brain and external devices. Among EEG-based BCI paradigms, the most commonly used one is motor imagery (MI). As a hot research topic, MI-EEG based BCI has largely contributed to medical field and smart home industry. However, because of the low signal-to-noise ratio (SNR) and the non-stationary characteristic of EEG data, it is difficult to correctly classify different types of MI-EEG signals. Recently, the advances in Deep Learning (DL) significantly facilitate the development of MI EEG-based BCIs. In this paper, we provide a systematic survey of DL-based MI-EEG classification methods. Specifically, we first comprehensively discuss several important aspects of DL-based MI-EEG classification, covering input formulations, network architectures, public datasets, etc. Then, we summarize problems in model performance comparison and give guidelines to future studies for fair performance comparison. Next, we fairly evaluate the representative DL-based models using source code released by the authors and meticulously analyse the evaluation results. By performing ablation study on the network architecture, we found that (1) effective feature fusion is indispensable for multi-stream CNN-based models. (2) LSTM should be combined with spatial feature extraction techniques to obtain good classification performance. (3) the use of dropout contributes little to improving the model performance, and that (4) adding fully connected layers to the models significantly increases their parameters but it might not improve their performance. Finally, we raise several open issues in MI-EEG classification and provide possible future research directions.

engineering, biomedical,computer science, artificial intelligence,medical informatics
MACNet: A Multidimensional Attention-Based Convolutional Neural Network for Lower-Limb Motor Imagery Classification

Ling-Long Li,Guang-Zhong Cao,Yue-Peng Zhang,Wan-Chen Li,Fang Cui

DOI: https://doi.org/10.3390/s24237611

IF: 3.9

2024-11-29

Sensors

Abstract:Decoding lower-limb motor imagery (MI) is highly important in brain‒computer interfaces (BCIs) and rehabilitation engineering. However, it is challenging to classify lower-limb MI from electroencephalogram (EEG) signals, because lower-limb motions (LLMs) including MI are excessively close to physiological representations in the human brain and generate low-quality EEG signals. To address this challenge, this paper proposes a multidimensional attention-based convolutional neural network (CNN), termed MACNet, which is specifically designed for lower-limb MI classification. MACNet integrates a temporal refining module and an attention-enhanced convolutional module by leveraging the local and global feature representation abilities of CNNs and attention mechanisms. The temporal refining module adaptively investigates critical information from each electrode channel to refine EEG signals along the temporal dimension. The attention-enhanced convolutional module extracts temporal and spatial features while refining the feature maps across the channel and spatial dimensions. Owing to the scarcity of public datasets available for lower-limb MI, a specified lower-limb MI dataset involving four routine LLMs is built, consisting of 10 subjects over 20 sessions. Comparison experiments and ablation studies are conducted on this dataset and a public BCI Competition IV 2a EEG dataset. The experimental results show that MACNet achieves state-of-the-art performance and outperforms alternative models for the subject-specific mode. Visualization analysis reveals the excellent feature learning capabilities of MACNet and the potential relationship between lower-limb MI and brain activity. The effectiveness and generalizability of MACNet are verified.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
An effective classification approach for EEG-based motor imagery tasks combined with attention mechanisms

Jixiang Li,Wuxiang Shi,Yurong Li

DOI: https://doi.org/10.1007/s11571-024-10115-y

2024-05-08

Cognitive Neurodynamics

Abstract:Currently, electroencephalogram (EEG)-based motor imagery (MI) signals have been received extensive attention, which can assist disabled subjects to control wheelchair, automatic driving and other activities. However, EEG signals are easily affected by some factors, such as muscle movements, wireless devices, power line, etc., resulting in the low signal-to-noise ratios and the worse recognition results on EEG decoding. Therefore, it is crucial to develop a stable model for decoding MI-EEG signals. To address this issue and further improve the decoding performance for MI tasks, a hybrid structure combining convolutional neural networks and bidirectional long short-term memory (BLSTM) model, namely CBLSTM, is developed in this study to handle the various EEG-based MI tasks. Besides, the attention mechanism (AM) model is further adopted to adaptively assign the weight of EEG vital features and enhance the expression which beneficial to classification for MI tasks. First of all, the spatial features and the time series features are extracted by CBLSTM from preprocessed MI-EEG data, respectively. Meanwhile, more effective features information can be mined by the AM model, and the softmax function is utilized to recognize intention categories. Ultimately, the numerical results illustrate that the model presented achieves an average accuracy of 98.40% on the public physioNet dataset and faster training process for decoding MI tasks, which is superior to some other advanced models. Ablation experiment performed also verifies the effectiveness and feasibility of the developed model. Moreover, the established network model provides a good basis for the application of brain-computer interface in rehabilitation medicine.

neurosciences
Hybrid deep neural network using transfer learning for EEG motor imagery decoding

Ruilong Zhang,Qun Zong,Liqian Dou,Xinyi Zhao,Yifan Tang,Zhiyu Li

DOI: https://doi.org/10.1016/j.bspc.2020.102144

IF: 5.1

2021-01-01

Biomedical Signal Processing and Control

Abstract:A major challenge in motor imagery (MI) of electroencephalogram (EEG) based brain–computer interfaces (BCIs) is the individual differences for different people. That the classification model should be retrained from scratch for a new subject often leads to unnecessary time consumption. In this paper, a "brain-ID" framework based on the hybrid deep neural network with transfer learning (HDNN-TL) is proposed to deal with individual differences of 4-class MI task. An end-to-end HDNN is developed to learn the common features of MI signal. HDNN consists of convolutional neural network (CNN) and Long Short-Term Memory (LSTM) which are utilized to decode the spatial and temporal features of the MI signal simultaneously. To deal with the EEG individual differences problem, transfer learning technique is implemented to fine-tune the followed fully connected (FC) layer to accommodate new subject with fewer training data. The classification performance on BCI competition IV dataset 2a by the proposed HDNN-TL in terms of kappa value is 0.8. We compared HDNN-TL, HDNN and other state-of-art methods and the experimental results demonstrate that the proposed method can get a satisfying result for new subjects with less time and fewer training data in MI task.

engineering, biomedical
Classification algorithm for EEG-based motor imagery using hybrid neural network with spatio-temporal convolution and multi-head attention mechanism

Xingbin Shi,Baojiang Li,Wenlong Wang,Yuxin Qin,Haiyan Wang,Xichao Wang

DOI: https://doi.org/10.1016/j.neuroscience.2023.07.020

IF: 3.708

2023-07-30

Neuroscience

Abstract:Motor imagery (MI) is a brain-computer interface (BCI) technique in which specific brain regions are activated when people imagine their limbs (or muscles) moving, even without actual movement. The technology converts electroencephalogram (EEG) signals generated by the brain into computer-readable commands by measuring neural activity. Classification of motor imagery is one of the tasks in BCI. Researchers have done a lot of work on motor imagery classification, and the existing literature has relatively mature decoding methods for two-class motor tasks. However, as the categories of EEG-based motor imagery tasks increase, further exploration is needed for decoding research on four-class motor imagery tasks. In this study, we designed a hybrid neural network that combines spatiotemporal convolution and attention mechanisms. Specifically, the data is first processed by spatiotemporal convolution to extract features and then processed by a Multi-branch Convolution block. Finally, the processed data is input into the encoder layer of the Transformer for a self-attention calculation to obtain the classification results. Our approach was tested on the well-known MI datasets BCI Competition IV 2a and 2b, and the results show that the 2a dataset has a global average classification accuracy of 83.3% and a kappa value of 0.78. Experimental results show that the proposed method outperforms most of the existing methods.

neurosciences
A Motor Imagery Signals Classification Method via the Difference of EEG Signals Between Left and Right Hemispheric Electrodes

Xiangmin Lun,Jianwei Liu,Yifei Zhang,Ziqian Hao,Yimin Hou

DOI: https://doi.org/10.3389/fnins.2022.865594

IF: 4.3

2022-05-10

Frontiers in Neuroscience

Abstract:Brain-computer interface (BCI) based on motor imagery (MI) can help patients with limb movement disorders in their normal life. In order to develop an efficient BCI system, it is necessary to decode high-accuracy motion intention by electroencephalogram (EEG) with low signal-to-noise ratio. In this article, a MI classification approach is proposed, combining the difference in EEG signals between the left and right hemispheric electrodes with a dual convolutional neural network (dual-CNN), which effectively improved the decoding performance of BCI. The positive and inverse problems of EEG were solved by the boundary element method (BEM) and weighted minimum norm estimation (WMNE), and then the scalp signals were mapped to the cortex layer. We created nine pairs of new electrodes on the cortex as the region of interest. The time series of the nine electrodes on the left and right hemispheric are respectively used as the input of the dual-CNN model to classify four MI tasks. The results show that this method has good results in both group-level subjects and individual subjects. On the Physionet database, the averaged accuracy on group-level can reach 96.36%, while the accuracies of four MI tasks reach 98.54, 95.02, 93.66, and 96.19%, respectively. As for the individual subject, the highest accuracy is 98.88%, and its four MI accuracies are 99.62, 99.68, 98.47, and 97.73%, respectively.

neurosciences
Optimizing EEG Signal Classification in BCI Systems: A Comparative Study of Hybrid Transfer Learning and Advanced Machine Learning Approaches

P S Thanigaivelu

DOI: https://doi.org/10.52783/jes.4832

2024-06-27

Abstract:Electroencephalogram (EEG) data can be challenging to classify for motor imagery (MI) tasks in brain-computer interfaces (BCI) due to low signal-to-noise ratios, complex patterns, and subject variability. This study aims to overcome these issues by evaluating various Transfer Learning (TL) and advanced machine learning models to improve EEG data classification accuracy. We pre-processed raw EEG signals into scalogram images by Continuous Wavelet Transform (CWT) and fed them into TL models like DenseNet, VGG19, ResNet, and InceptionV3. Features from these models were classified using advanced machine learning classifiers, including Random Forest, K-Nearest Neighbours, Decision Tree, and XGBoost. Using the BCI Competition IV 2a raw dataset, DenseNet combined with XGBoost achieved 99.2% classification accuracy on both training and validation datasets. According to the study, TL-based architecture can be used for controlling rehabilitation devices using EEG data for post-stroke patients, improving their quality of life and facilitating a more convenient way for individuals with severe physical disabilities to manage their healthcare via hybrid TL and advanced ML integrated BCI systems.
Deep learning classification of EEG-based BCI monitoring of the attempted arm and hand movements

Sahar Taghi Zadeh Makouei,Caglar Uyulan

DOI: https://doi.org/10.1515/bmt-2023-0356

2024-06-04

Biomedical Engineering / Biomedizinische Technik

Abstract:The primary objective of this research is to improve the average classification performance for specific movements in patients with cervical spinal cord injury (SCI). The study utilizes a low-frequency multi-class electroencephalography (EEG) dataset from Graz University of Technology. The research combines convolutional neural network (CNN) and long-short-term memory (LSTM) architectures to uncover neural correlations between temporal and spatial aspects of the EEG signals associated with attempted arm and hand movements. To achieve this, three different methods are used to select relevant features, and the proposed model's robustness against variations in the data is validated using 10-fold cross-validation (CV). The research also investigates subject-specific adaptation in an online paradigm, extending movement classification proof-of-concept. The combined CNN-LSTM model, enhanced by three feature selection methods, demonstrates robustness with a mean accuracy of 75.75 % and low standard deviation (+/− 0.74 %) in 10-fold cross-validation, confirming its reliability. In summary, this research aims to make valuable contributions to the field of neuro-technology by developing EEG-controlled assistive devices using a generalized brain-computer interface (BCI) and deep learning (DL) framework. The focus is on capturing high-level spatiotemporal features and latent dependencies to enhance the performance and usability of EEG-based assistive technologies.

engineering, biomedical,medical informatics
Visual Motion Imagery Classification with Deep Neural Network based on Functional Connectivity

Byoung-Hee Kwon,Ji-Hoon Jeong,Seong-Whan Lee

DOI: https://doi.org/10.48550/arXiv.2103.02851

IF: 6.4588

2021-03-04

Human-Computer Interaction

Abstract:Brain-computer interfaces (BCIs) use brain signals such as electroencephalography to reflect user intention and enable two-way communication between computers and users. BCI technology has recently received much attention in healthcare applications, such as neurorehabilitation and diagnosis. BCI applications can also control external devices using only brain activity, which can help people with physical or mental disabilities, especially those suffering from neurological and neuromuscular diseases such as stroke and amyotrophic lateral sclerosis. Motor imagery (MI) has been widely used for BCI-based device control, but we adopted intuitive visual motion imagery to overcome the weakness of MI. In this study, we developed a three-dimensional (3D) BCI training platform to induce users to imagine upper-limb movements used in real-life activities (picking up a cell phone, pouring water, opening a door, and eating food). We collected intuitive visual motion imagery data and proposed a deep learning network based on functional connectivity as a mind-reading technique. As a result, the proposed network recorded a high classification performance on average (71.05%). Furthermore, we applied the leave-one-subject-out approach to confirm the possibility of improvements in subject-independent classification performance. This study will contribute to the development of BCI-based healthcare applications for rehabilitation, such as robotic arms and wheelchairs, or assist daily life.
A Study of Unilateral Upper Limb Fine Motor Imagery Decoding Using Frequency-Band Attention Network

Tianyu Shi,Xiang Gu,Hui Bi,Jidong Lv,Yan Liu,Yakang Dai,Ling Zou

DOI: https://doi.org/10.1109/access.2024.3371904

IF: 3.9

2024-03-09

IEEE Access

Abstract:Brain-computer interface (BCI) based motor imagery (MI) can assist stroke patients in upper limb rehabilitation and help restore motor function to a certain extent. However, the classical MI paradigm distinguishes different limbs and cannot effectively meet the needs of upper limb rehabilitation training for patients. Therefore, this paper designed a new paradigm for three motor imagery actions targeting different joints of the unilateral upper limb, and electroencephalogram (EEG) data from 20 healthy participants were collected for research analysis. A deep neural network model combining an attention mechanism for multiple frequency bands and a deep convolutional network were proposed to adaptively assign weight to the EEG data in different frequency bands. Then feature extraction was performed for each frequency band to learn further and to classify features. This model can obtain an average accuracy of 69.2% for the subject-independent case with the triple classification in the designed fine motor imagery (FMI) dataset, which is better than other controlled methods. Furthermore, ablation experiments were conducted for each module, demonstrating the effectiveness of each module. These results manifest the feasibility of our proposed method and the potential of FMI paradigm for BCI, providing a new training tool for upper limb rehabilitation after stroke.

computer science, information systems,telecommunications,engineering, electrical & electronic
Recognition of single upper limb motor imagery tasks from EEG using multi-branch fusion convolutional neural network

Rui Zhang,Yadi Chen,Zongxin Xu,Lipeng Zhang,Yuxia Hu,Mingming Chen

DOI: https://doi.org/10.3389/fnins.2023.1129049

IF: 4.3

2023-02-23

Frontiers in Neuroscience

Abstract:Motor imagery-based brain-computer interfaces (MI-BCI) have important application values in the field of neurorehabilitation and robot control. At present, MI-BCI mostly use bilateral upper limb motor tasks, but there are relatively few studies on single upper limb MI tasks. In this work, we conducted studies on the recognition of motor imagery EEG signals of the right upper limb and proposed a multi-branch fusion convolutional neural network (MF-CNN) for learning the features of the raw EEG signals as well as the two-dimensional time-frequency maps at the same time. The dataset used in this study contained three types of motor imagery tasks: extending the arm, rotating the wrist, and grasping the object, 25 subjects were included. In the binary classification experiment between the grasping object and the arm-extending tasks, MF-CNN achieved an average classification accuracy of 78.52% and kappa value of 0.57. When all three tasks were used for classification, the accuracy and kappa value were 57.06% and 0.36, respectively. The comparison results showed that the classification performance of MF-CNN is higher than that of single CNN branch algorithms in both binary-class and three-class classification. In conclusion, MF-CNN makes full use of the time-domain and frequency-domain features of EEG, can improve the decoding accuracy of single limb motor imagery tasks, and it contributes to the application of MI-BCI in motor function rehabilitation training after stroke.

neurosciences
A novel multi-branch hybrid neural network for motor imagery EEG signal classification

Weifeng Ma,Haojie Xue,Xiaoyong Sun,Sijia Mao,Liudi Wang,Yang Liu,Yuchen Wang,Xuefen Lin

DOI: https://doi.org/10.1016/j.bspc.2022.103718

IF: 5.1

2022-08-01

Biomedical Signal Processing and Control

Abstract:As a typical spontaneous brain-computer interface system, motor imagery has been widely used in areas such as robot control and stroke rehabilitation. Recently, researchers have started to study and propose various Convolutional Neural Network (CNN) structures based on motor imagery signals and have obtained better decoding accuracy compared with traditional machine learning algorithms. In this paper, we focus on a four-class motor imagery task. Therefore, we propose an end-to-end novel multi-branch hybrid neural network for motor imagery EEG signal classification. Notably, we divide the input signal into four frequency bands associated with the motor imagery signal. Meanwhile, we also introduced a Bidirectional Gated Recurrent Unit (BGRU) to identify EEG features. Nevertheless, it is extremely difficult to collect high-quality EEG data and the classification accuracy is degraded due to the strict requirements of the subjects and the experimental environment. To address this issue, we propose a novel data augmentation approach for frequency domain segmentation swap (Seg-Swap) for improving EEG motor imagery signal classification accuracy. We make use of the publicly available BCI IV 2a dataset and High Gamma dataset to evaluate the decoding performance of the model. The proposed multi-branch hybrid neural network (MBHNN) achieves 86.15% and 95.04% on the both datasets. Compared with several state-of-the-art (SOA) algorithms, our proposed model has a slight improvement in classification accuracy. Experimental results show that our proposed MBHNN has higher decoding classification and stronger robustness.

engineering, biomedical
Deep learning for hybrid EEG-fNIRS brain–computer interface: application to motor imagery classification

Antonio Maria Chiarelli,Pierpaolo Croce,Arcangelo Merla,Filippo Zappasodi

DOI: https://doi.org/10.1088/1741-2552/aaaf82

IF: 5.043

2018-04-16

Journal of Neural Engineering

Abstract:OBJECTIVE: Brain-computer interface (BCI) refers to procedures that link the central nervous system to a device. BCI was historically performed using electroencephalography (EEG). In the last years, encouraging results were obtained by combining EEG with other neuroimaging technologies, such as functional near infrared spectroscopy (fNIRS). A crucial step of BCI is brain state classification from recorded signal features. Deep artificial neural networks (DNNs) recently reached unprecedented complex classification outcomes. These performances were achieved through increased computational power, efficient learning algorithms, valuable activation functions, and restricted or back-fed neurons connections. By expecting significant overall BCI performances, we investigated the capabilities of combining EEG and fNIRS recordings with state-of-the-art deep learning procedures.APPROACH: We performed a guided left and right hand motor imagery task on 15 subjects with a fixed classification response time of 1 s and overall experiment length of 10 min. Left versus right classification accuracy of a DNN in the multi-modal recording modality was estimated and it was compared to standalone EEG and fNIRS and other classifiers.MAIN RESULTS: At a group level we obtained significant increase in performance when considering multi-modal recordings and DNN classifier with synergistic effect.SIGNIFICANCE: BCI performances can be significantly improved by employing multi-modal recordings that provide electrical and hemodynamic brain activity information, in combination with advanced non-linear deep learning classification procedures.

engineering, biomedical,neurosciences
Single-trial EEG Classification of Motor Imagery Using Deep Convolutional Neural Networks

Zhichuan Tang,Chao Li,Shouqian Sun

DOI: https://doi.org/10.1016/j.ijleo.2016.10.117

IF: 3.1

2017-01-01

Optik

Abstract:Electroencephalogram (EEG) signal recorded during motor imagery (MI) has been widely applied in non-invasive brain–computer interface (BCI) as a communication approach. In this paper, we propose a new method based on the deep convolutional neural network (CNN) to perform feature extraction and classification for single-trial MI EEG. Firstly, based on the spatio-temporal characteristics of EEG, a 5-layer CNN model is built to classify MI tasks (left hand and right hand movement); then the CNN model is applied in the experimental data set collected from subjects, and compared with other three conventional classification methods (power+SVM, CSP+SVM and AR+SVM). The results demonstrate that CNN can further improve classification performance: the average accuracy using CNN (86.41±0.77%) is 9.24%, 3.80% and 5.16% higher than those using power+SVM, CSP+SVM and AR+SVM, respectively. The present study shows that the proposed method is effective to classify MI, and provides a practical method by non-invasive EEG signal in BCI applications.

A new method for classifying complex filiform Lie algebras

Machine Learning for Multi-Action Classification of Lower Limbs for BCI

Motor Imagery Classification Based on Deep Convolutional Neural Network and Its Application in Exoskeleton Controlled by EEG

A transfer learning-based CNN and LSTM hybrid deep learning model to classify motor imagery EEG signals

A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation

Classification of EEG signals related to real and imagery knee movements using deep learning for brain computer interfaces

Enhance Decoding of Functional Lower-Limb Movements by Combining Sensory Motor Rhythm and Movement-Related Cortical Potential Features

An in-depth survey on Deep Learning-based Motor Imagery Electroencephalogram (EEG) classification

MACNet: A Multidimensional Attention-Based Convolutional Neural Network for Lower-Limb Motor Imagery Classification

An effective classification approach for EEG-based motor imagery tasks combined with attention mechanisms

Hybrid deep neural network using transfer learning for EEG motor imagery decoding

Classification algorithm for EEG-based motor imagery using hybrid neural network with spatio-temporal convolution and multi-head attention mechanism

A Motor Imagery Signals Classification Method via the Difference of EEG Signals Between Left and Right Hemispheric Electrodes

Optimizing EEG Signal Classification in BCI Systems: A Comparative Study of Hybrid Transfer Learning and Advanced Machine Learning Approaches

Deep learning classification of EEG-based BCI monitoring of the attempted arm and hand movements

Visual Motion Imagery Classification with Deep Neural Network based on Functional Connectivity

A Study of Unilateral Upper Limb Fine Motor Imagery Decoding Using Frequency-Band Attention Network

Recognition of single upper limb motor imagery tasks from EEG using multi-branch fusion convolutional neural network

A novel multi-branch hybrid neural network for motor imagery EEG signal classification

Deep learning for hybrid EEG-fNIRS brain–computer interface: application to motor imagery classification

Single-trial EEG Classification of Motor Imagery Using Deep Convolutional Neural Networks