Abstract:Towards practical applications of Electroencephalography (EEG) data, lightweight acquisition devices, equipped with a few electrodes, result in a predicament where analysis methods can only leverage EEG data with extremely low spatial resolution. Recent methods mainly focus on using mathematical interpolation methods and Convolutional Neural Networks for EEG super-resolution (SR), but they suffer from high computation costs, extra bias, and few insights in spatiotemporal dependency modeling. To this end, we propose the ESTformer, an EEG SR framework utilizing spatiotemporal dependencies based on the Transformer. The ESTformer applies positional encoding methods and the Multi-head Self-attention mechanism to the space and time dimensions, which can learn spatial structural information and temporal functional variation. The ESTformer, with the fixed masking strategy, adopts a mask token to up-sample the low-resolution (LR) EEG data in case of disturbance from mathematical interpolation methods. On this basis, we design various Transformer blocks to construct the Spatial Interpolation Module (SIM) and the Temporal Reconstruction Module (TRM). Finally, the ESTformer cascades the SIM and the TRM to capture and model spatiotemporal dependencies for EEG SR with fidelity. Extensive experimental results on two EEG datasets show the effectiveness of the ESTformer against previous state-of-the-art methods and verify the superiority of the SR data to the LR data in EEG-based downstream tasks of person identification and emotion recognition. The proposed ESTformer demonstrates the versatility of the Transformer for EEG SR tasks.

What problem does this paper attempt to address?

### Problems Addressed by the Paper The paper primarily aims to address the issue of reduced spatial resolution in electroencephalogram (EEG) data in practical applications due to the decreased number of electrodes in collection devices. Specifically: 1. **Background Issue**: - Lightweight EEG collection devices are convenient, but the reduced number of electrodes leads to lower spatial resolution, affecting the effectiveness of subsequent analysis methods. 2. **Problems with Existing Methods**: - Current methods mainly rely on mathematical interpolation methods and convolutional neural networks (CNN) for EEG super-resolution (SR). However, these methods have high computational costs, introduce additional biases, and inadequately model spatiotemporal dependencies. 3. **Proposed Solution**: - To address this, the authors propose the ESTformer framework, a Transformer-based EEG super-resolution framework that leverages spatiotemporal dependencies to enhance the quality of low-resolution EEG data. ESTformer achieves this through: - Using positional encoding methods and multi-head self-attention mechanisms to model spatial structural information and temporal functional changes. - Adopting a fixed mask strategy and mask tokens to upsample low-resolution EEG data, avoiding the interference caused by mathematical interpolation methods. - Designing various Transformer blocks to construct a Spatial Interpolation Module (SIM) and a Temporal Reconstruction Module (TRM), and cascading these two modules to capture and model spatiotemporal dependencies. 4. **Experimental Validation**: - Extensive experimental results on two EEG datasets validate the effectiveness of ESTformer and demonstrate its advantages over existing methods. Additionally, the superior performance of super-resolution EEG data in downstream tasks such as human recognition and emotion recognition is showcased. Through this research, ESTformer demonstrates the potential of the Transformer architecture in EEG super-resolution tasks and addresses the high computational costs and inadequate spatiotemporal dependency modeling present in existing methods.

ESTformer: Transformer Utilizing Spatiotemporal Dependencies for EEG Super-resolution

JDAT: Joint-Dimension-Aware Transformer with Strong Flexibility for EEG Emotion Recognition

EEGformer: A transformer-based brain activity classification method using EEG signal

Transformer-based Spatial-Temporal Feature Learning for EEG Decoding

FAformer: Parallel Fourier-attention Architectures Benefits EEG-based Affective Computing with Enhanced Spatial Information

A spatiotemporal symmetrical transformer structure for EEG emotion recognition

Spatial-temporal Transformers for EEG Emotion Recognition

EEG temporal–spatial transformer for person identification

Spatio-Temporal Analysis of Transformer based Architecture for Attention Estimation from EEG

Dual-TSST: A Dual-Branch Temporal-Spectral-Spatial Transformer Model for EEG Decoding

Temporal-spatial Representation Learning Transformer for EEG-based Emotion Recognition

Emotion recognition using hierarchical spatial-temporal learning transformer from regional to global brain

Temporal Relative Transformer Encoding Cooperating with Channel Attention for EEG Emotion Analysis

Generative AI Enables EEG Super-Resolution via Spatio-Temporal Adaptive Diffusion Learning

EEG Conformer: Convolutional Transformer for EEG Decoding and Visualization

Large Transformers are Better EEG Learners

MEET: A Multi-Band EEG Transformer for Brain States Decoding.

A Transformer-Based Approach Combining Deep Learning Network and Spatial-Temporal Information for Raw EEG Classification

EEG-Deformer: A Dense Convolutional Transformer for Brain-computer Interfaces

Spatial-angular-epipolar Transformer for Light Field Spatial and Angular Super-Resolution