[Natural history of peptic ulcers].

M. Asaka

1995-06-10

Abstract:

What problem does this paper attempt to address?

JDAT: Joint-Dimension-Aware Transformer with Strong Flexibility for EEG Emotion Recognition

Zeyu Wang,Ziqun Zhou,Haibin Shen,Qi Xu,Kejie Huang

DOI: https://doi.org/10.36227/techrxiv.17056961

2021-01-01

Abstract:Electroencephalography (EEG) emotion recognition, an important task in Human-Computer Interaction (HCI), has made a great breakthrough with the help of deep learning algorithms. Although the application of attention mechanism on conventional models has improved its performance, most previous research rarely focused on multiplex EEG features jointly, lacking a compact model with unified attention modules. This study proposes Joint-Dimension-Aware Transformer (JDAT), a robust model based on squeezed Multi-head Self-Attention (MSA) mechanism for EEG emotion recognition. The adaptive squeezed MSA applied on multidimensional features enables JDAT to focus on diverse EEG information, including space, frequency, and time. Under the joint attention, JDAT is sensitive to the complicated brain activities, such as signal activation, phase-intensity couplings, and resonance. Moreover, its gradually compressed structure contains no recurrent or parallel modules, greatly reducing the memory and complexity, and accelerating the inference process. The proposed JDAT is evaluated on DEAP, DREAMER, and SEED datasets, and experimental results show that it outperforms state-of-the-art methods along with stronger flexibility.
Time–frequency–space transformer EEG decoding for spinal cord injury

Fangzhou Xu,Ming Liu,Xinyi Chen,Yihao Yan,Jinzhao Zhao,Yanbing Liu,Jiaqi Zhao,Shaopeng Pang,Sen Yin,Jiancai Leng,Yang Zhang

DOI: https://doi.org/10.1007/s11571-024-10135-8

2024-06-19

Cognitive Neurodynamics

Abstract:Transformer neural networks based on multi-head self-attention are effective in several fields. To capture brain activity on electroencephalographic (EEG) signals and construct an effective pattern recognition model, this paper explores the multi-channel deep feature decoding method utilizing the self-attention mechanism. By integrating inter-channel features with intra-channel features, the self-attention mechanism generates a deep feature vector that encompasses information from all brain activities. In this paper, a time-frequency-spatial domain analysis of motor imagery (MI) based EEG signals from spinal cord injury patients is performed to construct a transformer neural network-based MI classification model. The proposed algorithm is named time-frequency-spatial transformer. The time-frequency and spatial domain feature vectors extracted from the EEG signals are input into the transformer neural network for multiple self-attention depth feature encoding, a peak classification accuracy of 93.56% is attained through the fully connected layer. By constructing the attention matrix brain network, it can be inferred that the channel connections constructed by the attention heads have similarities to the brain networks constructed by the EEG raw signals. The experimental results reveal that the self-attention coefficient brain network holds significant potential for brain activity analysis. The self-attention coefficient brain network can better illustrate correlated connections and show sample differences. Attention coefficient brain networks can provide a more discriminative approach for analyzing brain activity in clinical settings.

neurosciences
A Transformer-Based Approach Combining Deep Learning Network and Spatial-Temporal Information for Raw EEG Classification

Jin Xie,Jie Zhang,Jiayao Sun,Zheng Ma,Liuni Qin,Guanglin Li,Huihui Zhou,Yang Zhan

DOI: https://doi.org/10.1109/tnsre.2022.3194600

IF: 4.9

2022-08-05

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:The attention mechanism of the Transformer has the advantage of extracting feature correlation in the long-sequence data and visualizing the model. As time-series data, the spatial and temporal dependencies of the EEG signals between the time points and the different channels contain important information for accurate classification. So far, Transformer-based approaches have not been widely explored in motor-imagery EEG classification and visualization, especially lacking general models based on cross-individual validation. Taking advantage of the Transformer model and the spatial-temporal characteristics of the EEG signals, we designed Transformer-based models for classifications of motor imagery EEG based on the PhysioNet dataset. With 3s EEG data, our models obtained the best classification accuracy of 83.31%, 74.44%, and 64.22% on two-, three-, and four-class motor-imagery tasks in cross-individual validation, which outperformed other state-of-the-art models by 0.88%, 2.11%, and 1.06%. The inclusion of the positional embedding modules in the Transformer could improve the EEG classification performance. Furthermore, the visualization results of attention weights provided insights into the working mechanism of the Transformer-based networks during motor imagery tasks. The topography of the attention weights revealed a pattern of event-related desynchronization (ERD) which was consistent with the results from the spectral analysis of Mu and beta rhythm over the sensorimotor areas. Together, our deep learning methods not only provide novel and powerful tools for classifying and understanding EEG data but also have broad applications for brain-computer interface (BCI) systems.

engineering, biomedical,rehabilitation
MSVTNet: Multi-Scale Vision Transformer Neural Network for EEG-Based Motor Imagery Decoding

Ke Liu,Tao Yang,Zhuliang Yu,Weibo Yi,Hong Yu,Guoyin Wang,Wei Wu

DOI: https://doi.org/10.1109/JBHI.2024.3450753

2024-08-27

Abstract:Object: Transformer-based neural networks have been applied to the electroencephalography (EEG) decoding for motor imagery (MI). However, most networks focus on applying the self-attention mechanism to extract global temporal information, while the cross-frequency coupling features between different frequencies have been neglected. Additionally, effectively integrating different neural networks poses challenges for the advanced design of decoding algorithms. Methods: This study proposes a novel end-to-end Multi-Scale Vision Transformer Neural Network (MSVTNet) for MI-EEG classification. MSVTNet first extracts local spatio-temporal features at different filtered scales through convolutional neural networks (CNNs). Then, these features are concatenated along the feature dimension to form local multi-scale spatio-temporal feature tokens. Finally, Transformers are utilized to capture cross-scale interaction information and global temporal correlations, providing more distinguishable feature embeddings for classification. Moreover, auxiliary branch loss is leveraged for intermediate supervision to ensure the effective integration of CNNs and Transformers. Results: The performance of MSVTNet was assessed through subject-dependent (session-dependent and session-independent) and subject-independent experiments on three MI datasets, i.e., the BCI competition IV 2a, 2b and OpenBMI datasets. The experimental results demonstrate that MSVTNet achieves state-of-the-art performance in all analyses. Conclusion: MSVTNet shows superiority and robustness in enhancing MI decoding performance. The source code for MSVTNet is available at https://github.com/SheepTAO/MSVTNet.
MI-MBFT: Superior Motor Imagery Decoding of Raw EEG Data Based on a Multi-Branch and Fusion Transformer Framework

Jingjing Luo,Qiying Cheng,Hongbo Wang,Qiang Du,Youhao Wang,Yang Li

DOI: https://doi.org/10.1109/jsen.2024.3445971

IF: 4.3

2024-01-01

IEEE Sensors Journal

Abstract:The potential of brain-computer interface (BCI) technology in stroke rehabilitation has garnered significant attention worldwide, particularly as motor imagery electroencephalogram (MI-EEG) signal decoding techniques have established a connection between biosignals and rehabilitation machines. However, EEG’s non-stationary nature and the susceptibility of its spatial-temporal features to brain conditions and environmental factors pose significant challenges. Most deep learning decoding networks tend to concentrate on local features, resulting in limitations when adapting to global-wise interdependencies. This paper presents an end-to-end multi-branch and fusion transformer (MBFT) framework to focus on and fuse full-sequence length spatial-temporal spectral information through self-attention, thereby adaptively capturing key elements in EEG signals. MI-EEG encompasses rhythmic characteristics of multiple spectra throughout the entire sequence and with intra-sequence interdependencies. To learn the global patterns of local features from multiple frequency bands in parallel, MBFT employs a multi-branch transformer encoder structures and further utilizes multi-head self-attention to acquire fused high-level features. Our proposed model demonstrates superior performance on various datasets. It achieves an average accuracy of 86.93% on the BCIC IV-2a dataset, 94.64% on the BCIC II-III dataset, and 93.52% on the MMIDB dataset, all achieving a new state-of-the-art (SOTA). This approach explores a novel network structure that may be more suitable for MI-EEG decoding, which helps improve the BCI system’s performance.
Transformer-based network with temporal depthwise convolutions for sEMG recognition

Zefeng Wang,Junfeng Yao,Meiyan Xu,Min Jiang,Jinsong Su

DOI: https://doi.org/10.1016/j.patcog.2023.109967

IF: 8

2023-09-23

Pattern Recognition

Abstract:Considerable progress has been made in pattern recognition of surface electromyography (sEMG) with deep learning, bringing improvements to sEMG-based gesture classification. Current deep learning techniques are mainly based on convolutional neural networks (CNNs), recurrent neural networks (RNNs), and their hybrids. However, CNNs focus on spatial and local information, while RNNs are unparallelizable, and they suffer from gradient vanishing/exploding. Their hybrids often face problems of model complexity and high computational cost. Because sEMG signals have a sequential nature, motivated by the sequence modeling network Transformer and its self-attention mechanism, we propose a Transformer-based network, temporal depthwise convolutional Transformer (TDCT), for sparse sEMG recognition. With this network, higher recognition accuracy is achieved with fewer convolution parameters and a lower computational cost. Specifically, this network has parallel capability and can capture long-range features inside sEMG signals. We improve the locality and channel correlation capture of multi-head self-attention (MSA) for sEMG modeling by replacing the linear transformation with the proposed temporal depthwise convolution (TDC), which can reduce the convolution parameters and computations for feature learning performance. Four sEMG datasets, Ninapro DB1, DB2, DB5, and OYDB, are used for evaluations and comparisons. In the results, our model outperforms other methods, including Transformer-based networks, in most windows at recognizing the raw signals of sparse sEMG, thus achieving state-of-the-art classification accuracy.

computer science, artificial intelligence,engineering, electrical & electronic
A Temporal-Spectral-Based Squeeze-and- Excitation Feature Fusion Network for Motor Imagery EEG Decoding

Yang Li,Lianghui Guo,Yu Liu,Jingyu Liu,Fangang Meng

DOI: https://doi.org/10.1109/tnsre.2021.3099908

IF: 4.9

2021-01-01

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Motor imagery (MI) electroencephalography (EEG) decoding plays an important role in brain-computer interface (BCI), which enables motor-disabled patients to communicate with the outside world via external devices. Recent deep learning methods, which fail to fully explore both deep-temporal characterizations in EEGs itself and multi-spectral information in different rhythms, generally ignore the temporal or spectral dependencies in MI-EEG. Also, the lack of effective feature fusion probably leads to redundant or irrelative information and thus fails to achieve the most discriminative features, resulting in the limited MI-EEG decoding performance. To address these issues, in this paper, a MI-EEG decoding framework is proposed, which uses a novel temporal-spectral-based squeeze-and-excitation feature fusion network (TS-SEFFNet). First, the deep-temporal convolution block (DT-Conv block) implements convolutions in a cascade architecture, which extracts high-dimension temporal representations from raw EEG signals. Second, the multi-spectral convolution block (MS-Conv block) is then conducted in parallel using multi-level wavelet convolutions to capture discriminative spectral features from corresponding clinical subbands. Finally, the proposed squeeze-and-excitation feature fusion block (SE-Feature-Fusion block) maps the deep-temporal and multi-spectral features into comprehensive fused feature maps, which highlights channel-wise feature responses by constructing interdependencies among different domain features. Competitive experimental results on two public datasets demonstrate that our method is able to achieve promising decoding performance compared with the state-of-the-art methods.

engineering, biomedical,rehabilitation
Deep temporal networks for EEG-based motor imagery recognition

Neha Sharma,Avinash Upadhyay,Manoj Sharma,Amit Singhal

DOI: https://doi.org/10.1038/s41598-023-41653-w

IF: 4.6

2023-11-03

Scientific Reports

Abstract:The electroencephalogram (EEG) based motor imagery (MI) signal classification, also known as motion recognition, is a highly popular area of research due to its applications in robotics, gaming, and medical fields. However, the problem is ill-posed as these signals are non-stationary and noisy. Recently, a lot of efforts have been made to improve MI signal classification using a combination of signal decomposition and machine learning techniques but they fail to perform adequately on large multi-class datasets. Previously, researchers have implemented long short-term memory (LSTM), which is capable of learning the time-series information, on the MI-EEG dataset for motion recognition. However, it can not model very long-term dependencies present in the motion recognition data. With the advent of transformer networks in natural language processing (NLP), the long-term dependency issue has been widely addressed. Motivated by the success of transformer algorithms, in this article, we propose a transformer-based deep learning neural network architecture that performs motion recognition on the raw BCI competition III IVa and IV 2a datasets. The validation results show that the proposed method achieves superior performance than the existing state-of-the-art methods. The proposed method produces classification accuracy of 99.7% and 84% on the binary class and the multi-class datasets, respectively. Further, the performance of the proposed transformer-based model is also compared with LSTM.

multidisciplinary sciences
EEG Classification with Transformer-Based Models

Jiayao Sun,Jin Xie,Huihui Zhou

DOI: https://doi.org/10.1109/LIFETECH52111.2021.9391844

2021-01-01

Abstract:Transformer has been widely used in the field of natural language processing (NLP) with its superior ability to handle long-range dependencies in comparison with convolutional neural network (CNN) and recurrent neural network (RNN). This correlation is also important for the recognition of time series signals, such as electroencephalogram (EEG). Currently, commonly used EEG classification models are CNN, RNN, deep believe network (DBN), and hybrid CNN. Transformer has not been used in EEG recognition. In this study, we constructed multiple Transformer-based models for motor imaginary (MI) EEG classification, and obtained superior performances in comparison with the previous state-of-art. We found that the activities of the motor cortex had a great contribution to classification in our model through visualization, and positional embedding (PE) method could improve classification accuracy. These results suggest that the attention mechanism of Transformer combined with CNN might be a powerful model for the recognition of sequence data.
EEGEncoder: Advancing BCI with Transformer-Based Motor Imagery Classification

Wangdan Liao,Weidong Wang

2024-06-24

Abstract:Brain-computer interfaces (BCIs) harness electroencephalographic signals for direct neural control of devices, offering a significant benefit for individuals with motor impairments. Traditional machine learning methods for EEG-based motor imagery (MI) classification encounter challenges such as manual feature extraction and susceptibility to noise.This paper introduces EEGEncoder, a deep learning framework that employs modified transformers and TCNs to surmount these limitations. We innovatively propose a fusion architecture, namely Dual-Stream Temporal-Spatial Block (DSTS), to capture temporal and spatial features, improving the accuracy of Motor Imagery classification task. Additionally, we use multiple parallel structures to enhance the performance of the model. When tested on the BCI Competition IV-2a dataset, our model results outperform current state-of-the-art techniques.

Human-Computer Interaction,Machine Learning
Effect of iridocryothermy in the normal dog.

K. P. Barrie,K. Gelatt,R. M. Gwin,R. Peiffer

American Journal of Veterinary Research

Abstract:The base and pupillary zones of the iris were exposed for 10 s to a -79 C cryoprobe (iridocryothermy). The resultant iritis lasted 7 to 10 days as evidenced by aqueous flare, hypotony, and miosis. At 21 days, the iris was depigmented and had an irregular pupil. The initial histopathologic changes after iridocryothermy were iridic intrastromal hemorrhage, exudation, and neutrophil infiltration. The iridic pigmented epithelium was lyzed, and the melanin granules were liberated into the iridic stroma, posterior, and anterior chambers. Irides frozen at the pupillary zone exhibited sphincter muscle degeneration. By 21 days after iridocryothermy, the irides were depigmented and atrophic.
TMSA-Net:A novel attention mechanism for improved motor imagery EEG signal processing

Qian Zhao,Weina Zhu

DOI: https://doi.org/10.1016/j.bspc.2024.107189

IF: 5.1

2024-12-03

Biomedical Signal Processing and Control

Abstract:Electroencephalography (EEG) is a non-invasive method used to record the brain's electrical activity, widely employed in brain-computer interface (BCI) applications for decoding motor imagery (MI) signals. Traditional models combining Convolutional Neural Networks (CNNs) and Transformers for decoding Motor Imagery Electroencephalography (MI-EEG) signals often struggle to capture the crucial interrelationships between local and global features effectively, resulting in suboptimal performance. To address this issue, we propose a novel computationally efficient model that integrates CNNs with a novel attention mechanism within the Transformer architecture. This approach effectively captures both local and global dependencies, thereby enhancing feature extraction and decoding accuracy. Evaluations against state-of-the-art models (EEGNet, Deep ConvNet, IFNet, Conformer) on three public datasets (BCIC-IV-2a, BCIC-IV-2b, HGD) reveal substantial performance enhancements. Specifically, our model achieves improvements in accuracy of 9.78%, 11.05%, 4.81%, and 3.75% over these models on the BCIC-IV-2a dataset. Ablation studies and visualization techniques (t-SNE, Grad-CAM) further corroborate the effectiveness and interpretability of our model, highlighting its superior decoding capabilities. The code is available at https://github.com/Whit3Zhao/TMSA-Net.git .

engineering, biomedical
Transformers for EEG-Based Emotion Recognition: A Hierarchical Spatial Information Learning Model

Zhe Wang,Yongxiong Wang,Chuanfei Hu,Zhong Yin,Yu Song

DOI: https://doi.org/10.1109/jsen.2022.3144317

IF: 4.3

2022-03-01

IEEE Sensors Journal

Abstract:The spatial information of Electroencephalography (EEG) is essential for emotion recognition model to learn discriminative feature. The convolutional networks and recurrent networks are the conventional choices to learn the complex spatial dependencies through a number of electrodes and brain regions. However, these models have difficulty in capturing long-range dependencies due to the operations of local feature learning. To enhance EEG spatial dependencies capturing and improve the accuracy of emotion recognition, we propose a transformer- based model to hierarchically learn the discriminative spatial information from electrode level to brain-region-level. In the electrode-level spatial learning, the transformer encoders are adopted to integrate information within different brain regions. Next, in view of the different roles of brain regions in the emotion recognition, the self-attention within the transformer could emphasize the contributive brain regions. Hence, in the brain-region-level spatial learning, a transformer encoder is utilized to capture the spatial dependencies among the brain regions. Finally, to validate the effectiveness of the proposed model, the subject-independent experiments are conducted on the DEAP and MAHNOB-HCI database. The experimental results demonstrate that the proposed model achieves outstanding performance in emotion recognition with arousal and valence level. Moreover, the visualization of self-attention indicates that the proposed model could emphasize the discriminative spatial information from pre-frontal lobe, frontal lobe, temporal lobe and parietal lobe.
Transformer-based Spatial-Temporal Feature Learning for EEG Decoding

Yonghao Song,Xueyu Jia,Lie Yang,Longhan Xie

DOI: https://doi.org/10.48550/arXiv.2106.11170

IF: 4.729

2021-06-11

Signal Processing

Abstract:At present, people usually use some methods based on convolutional neural networks (CNNs) for Electroencephalograph (EEG) decoding. However, CNNs have limitations in perceiving global dependencies, which is not adequate for common EEG paradigms with a strong overall relationship. Regarding this issue, we propose a novel EEG decoding method that mainly relies on the attention mechanism. The EEG data is firstly preprocessed and spatially filtered. And then, we apply attention transforming on the feature-channel dimension so that the model can enhance more relevant spatial features. The most crucial step is to slice the data in the time dimension for attention transforming, and finally obtain a highly distinguishable representation. At this time, global averaging pooling and a simple fully-connected layer are used to classify different categories of EEG data. Experiments on two public datasets indicate that the strategy of attention transforming effectively utilizes spatial and temporal features. And we have reached the level of the state-of-the-art in multi-classification of EEG, with fewer parameters. As far as we know, it is the first time that a detailed and complete method based on the transformer idea has been proposed in this field. It has good potential to promote the practicality of brain-computer interface (BCI). The source code can be found at: \textit{https://github.com/anranknight/EEG-Transformer}.
Gcm proteins function in the developing nervous system.

Haian Mao,Z. Lv,M. Ho

DOI: https://doi.org/10.1016/j.ydbio.2012.07.018

IF: 3.148

2012-10-01

Developmental Biology

Abstract:
Temporal-spatial Representation Learning Transformer for EEG-based Emotion Recognition

Zhe Wang,Yongxiong Wang,Chuanfei Hu,Zhong Yin,Yu Song

DOI: https://doi.org/10.48550/arXiv.2211.08880

2022-11-16

Abstract:Both the temporal dynamics and spatial correlations of Electroencephalogram (EEG), which contain discriminative emotion information, are essential for the emotion recognition. However, some redundant information within the EEG signals would degrade the performance. Specifically,the subjects reach prospective intense emotions for only a fraction of the stimulus duration. Besides, it is a challenge to extract discriminative features from the complex spatial correlations among a number of electrodes. To deal with the problems, we propose a transformer-based model to robustly capture temporal dynamics and spatial correlations of EEG. Especially, temporal feature extractors which share the weight among all the EEG channels are designed to adaptively extract dynamic context information from raw signals. Furthermore, multi-head self-attention mechanism within the transformers could adaptively localize the vital EEG fragments and emphasize the essential brain regions which contribute to the performance. To verify the effectiveness of the proposed method, we conduct the experiments on two public datasets, DEAP and MAHNOBHCI. The results demonstrate that the proposed method achieves outstanding performance on arousal and valence classification.

Signal Processing
A Novel Hybrid CNN-Transformer Model for EEG Motor Imagery Classification

Yaxin Ma,Yonghao Song,Fei Gao

DOI: https://doi.org/10.1109/ijcnn55064.2022.9892821

2022-01-01

Abstract:Motor imagery is one of the most popular brain-computer interface (BCI) paradigms with good potential to help disabled people. However, EEG decoding is still challenging because of its low signal-to-noise ratio, with which valuable features are difficult to perceive. In this paper, we propose a hybrid model that combines a convolutional neural network (CNN) with the Transformer for decoding motor imagery EEG signals. The CNN is used to extract local features, while the Transformer is utilized to perceive global dependencies. Moreover, we exploit spatial-spectral-temporal features to improve classification performance. To validate the effectiveness and superiority of the proposed method, we conduct experiments on the BCICIV dataset 2a and compare it with other efficient approaches. The results show that our algorithm outperforms the state-of-the-art methods, indicating that the CNN-Transformer model is a competing strategy.
EEG-VTTCNet: A loss joint training model based on the vision transformer and the temporal convolution network for EEG-based motor imagery classification

Xingbin Shi,Baojiang Li,Wenlong Wang,Yuxin Qin,Haiyan Wang,Xichao Wang

DOI: https://doi.org/10.1016/j.neuroscience.2024.07.051

IF: 3.708

2024-09-25

Neuroscience

Abstract:Brain-computer interface (BCI) is a technology that directly connects signals between the human brain and a computer or other external device. Motor imagery electroencephalographic (MI-EEG) signals are considered a promising paradigm for BCI systems, with a wide range of potential applications in medical rehabilitation, human-computer interaction, and virtual reality. Accurate decoding of MI-EEG signals poses a significant challenge due to issues related to the quality of the collected EEG data and subject variability. Therefore, developing an efficient MI-EEG decoding network is crucial and warrants research. This paper proposes a loss joint training model based on the vision transformer (VIT) and the temporal convolutional network (EEG-VTTCNet) to classify MI-EEG signals. To take advantage of multiple modules together, the EEG-VTTCNet adopts a shared convolution strategy and a dual-branching strategy. The dual-branching modules perform complementary learning and jointly train shared convolutional modules with better performance. We conducted experiments on the BCI Competition IV-2a and IV-2b datasets, and the proposed network outperformed the current state-of-the-art techniques with an accuracy of 84.58% and 90.94%, respectively, for the subject-dependent mode. In addition, we used t-SNE to visualize the features extracted by the proposed network, further demonstrating the effectiveness of the feature extraction framework. We also conducted extensive ablation and hyperparameter tuning experiments to construct a robust network architecture that can be well generalized.
Classification algorithm for EEG-based motor imagery using hybrid neural network with spatio-temporal convolution and multi-head attention mechanism

Xingbin Shi,Baojiang Li,Wenlong Wang,Yuxin Qin,Haiyan Wang,Xichao Wang

DOI: https://doi.org/10.1016/j.neuroscience.2023.07.020

IF: 3.708

2023-07-30

Neuroscience

Abstract:Motor imagery (MI) is a brain-computer interface (BCI) technique in which specific brain regions are activated when people imagine their limbs (or muscles) moving, even without actual movement. The technology converts electroencephalogram (EEG) signals generated by the brain into computer-readable commands by measuring neural activity. Classification of motor imagery is one of the tasks in BCI. Researchers have done a lot of work on motor imagery classification, and the existing literature has relatively mature decoding methods for two-class motor tasks. However, as the categories of EEG-based motor imagery tasks increase, further exploration is needed for decoding research on four-class motor imagery tasks. In this study, we designed a hybrid neural network that combines spatiotemporal convolution and attention mechanisms. Specifically, the data is first processed by spatiotemporal convolution to extract features and then processed by a Multi-branch Convolution block. Finally, the processed data is input into the encoder layer of the Transformer for a self-attention calculation to obtain the classification results. Our approach was tested on the well-known MI datasets BCI Competition IV 2a and 2b, and the results show that the 2a dataset has a global average classification accuracy of 83.3% and a kappa value of 0.78. Experimental results show that the proposed method outperforms most of the existing methods.

neurosciences
EmT: A Novel Transformer for Generalized Cross-subject EEG Emotion Recognition

Yi Ding,Chengxuan Tong,Shuailei Zhang,Muyun Jiang,Yong Li,Kevin Lim Jun Liang,Cuntai Guan

2024-06-26

Abstract:Integrating prior knowledge of neurophysiology into neural network architecture enhances the performance of emotion decoding. While numerous techniques emphasize learning spatial and short-term temporal patterns, there has been limited emphasis on capturing the vital long-term contextual information associated with emotional cognitive processes. In order to address this discrepancy, we introduce a novel transformer model called emotion transformer (EmT). EmT is designed to excel in both generalized cross-subject EEG emotion classification and regression tasks. In EmT, EEG signals are transformed into a temporal graph format, creating a sequence of EEG feature graphs using a temporal graph construction module (TGC). A novel residual multi-view pyramid GCN module (RMPG) is then proposed to learn dynamic graph representations for each EEG feature graph within the series, and the learned representations of each graph are fused into one token. Furthermore, we design a temporal contextual transformer module (TCT) with two types of token mixers to learn the temporal contextual information. Finally, the task-specific output module (TSO) generates the desired outputs. Experiments on four publicly available datasets show that EmT achieves higher results than the baseline methods for both EEG emotion classification and regression tasks. The code is available at <a class="link-external link-https" href="https://github.com/yi-ding-cs/EmT" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Signal Processing

[Natural history of peptic ulcers].

JDAT: Joint-Dimension-Aware Transformer with Strong Flexibility for EEG Emotion Recognition

Time–frequency–space transformer EEG decoding for spinal cord injury

A Transformer-Based Approach Combining Deep Learning Network and Spatial-Temporal Information for Raw EEG Classification

MSVTNet: Multi-Scale Vision Transformer Neural Network for EEG-Based Motor Imagery Decoding

MI-MBFT: Superior Motor Imagery Decoding of Raw EEG Data Based on a Multi-Branch and Fusion Transformer Framework

Transformer-based network with temporal depthwise convolutions for sEMG recognition

A Temporal-Spectral-Based Squeeze-and- Excitation Feature Fusion Network for Motor Imagery EEG Decoding

Deep temporal networks for EEG-based motor imagery recognition

EEG Classification with Transformer-Based Models

EEGEncoder: Advancing BCI with Transformer-Based Motor Imagery Classification

Effect of iridocryothermy in the normal dog.

TMSA-Net:A novel attention mechanism for improved motor imagery EEG signal processing

Transformers for EEG-Based Emotion Recognition: A Hierarchical Spatial Information Learning Model

Transformer-based Spatial-Temporal Feature Learning for EEG Decoding

Gcm proteins function in the developing nervous system.

Temporal-spatial Representation Learning Transformer for EEG-based Emotion Recognition

A Novel Hybrid CNN-Transformer Model for EEG Motor Imagery Classification

EEG-VTTCNet: A loss joint training model based on the vision transformer and the temporal convolution network for EEG-based motor imagery classification

Classification algorithm for EEG-based motor imagery using hybrid neural network with spatio-temporal convolution and multi-head attention mechanism

EmT: A Novel Transformer for Generalized Cross-subject EEG Emotion Recognition