Abstract:Highlights • We propose a model to detect the spatial locus of a listener's auditory attention. • EEG is modeled as a graph with node features based on time-frequency feature fusion. • Graph convolution can take advantage of local brain neuroanatomical connectivity. • Global attention mechanism is adopted to learn global brain effective connectivity. • Right-lateralized frontotemporal activation and connectivity exist in spatial hearing. Auditory spatial attention detection (ASAD) aims to decipher the spatial locus of a listener's selective auditory attention from electroencephalogram (EEG) signals. However, current models may exhibit deficiencies in EEG feature extraction, leading to overfitting on small datasets or a decline in EEG discriminability. Furthermore, they often neglect topological relationships between EEG channels and, consequently, brain connectivities. Although graph-based EEG modeling has been employed in ASAD, effectively incorporating both local and global connectivities remains a great challenge. To address these limitations, we propose a new ASAD model. First, time-frequency feature fusion provides a more precise and discriminative EEG representation. Second, EEG segments are treated as graphs, and the graph convolution and global attention mechanism are leveraged to capture local and global brain connections, respectively. A series of experiments are conducted in a leave-trials-out cross-validation manner. On the MAD-EEG and KUL datasets, the accuracies of the proposed model are more than 9% and 3% higher than those of the corresponding state-of-the-art models, respectively, while the accuracy of the proposed model on the SNHL dataset is roughly comparable to that of the state-of-the-art model. EEG time-frequency feature fusion proves to be indispensable in the proposed model. EEG electrodes over the frontal cortex are most important for ASAD tasks, followed by those over the temporal lobe. Additionally, the proposed model performs well even on small datasets. This study contributes to a deeper understanding of the neural encoding related to human hearing and attention, with potential applications in neuro-steered hearing devices.

STAnet: A Spatiotemporal Attention Network for Decoding Auditory Spatial Attention from EEG

Decoding auditory attention (in real time) with eeg

A DenseNet-based method for decoding auditory spatial attention with EEG

TAnet: A New Temporal Attention Network for EEG-based Auditory Spatial Attention Decoding with a Short Decision Window

Using Ear-EEG to Decode Auditory Attention in Multiple-speaker Environment

Brain connectivity and time-frequency fusion-based auditory spatial attention detection

Detecting the Locus of Auditory Attention Based on the Spectro-Spatial-temporal Analysis of EEG.

EEG-Based Auditory Attention Detection via Frequency and Channel Neural Attention

Auditory attention decoding from electroencephalography based on long short-term memory networks

AADNet: An End-to-End Deep Learning Model for Auditory Attention Decoding

SADNet: Sustained Attention Decoding in a Driving Task by Self-Attention Convolutional Neural Network

Low-latency auditory spatial attention detection based on spectro-spatial features from EEG

Low Latency Auditory Attention Detection with Common Spatial Pattern Analysis of EEG Signals.

EEG-based Auditory Attention Detection with Spiking Graph Convolutional Network

Attention-guided graph structure learning network for EEG-enabled auditory attention detection

DARNet: Dual Attention Refinement Network with Spatiotemporal Construction for Auditory Attention Detection

Subject-independent auditory spatial attention detection based on brain topology modeling and feature distribution alignment

Auditory Attention Detection via Cross-Modal Attention

Fast EEG-Based Decoding Of The Directional Focus Of Auditory Attention Using Common Spatial Patterns

DGSD: Dynamical Graph Self-Distillation for EEG-Based Auditory Spatial Attention Detection

Auditory Attention Decoding in Four-Talker Environment with EEG