Abstract:Highlights • We propose a model to detect the spatial locus of a listener's auditory attention. • EEG is modeled as a graph with node features based on time-frequency feature fusion. • Graph convolution can take advantage of local brain neuroanatomical connectivity. • Global attention mechanism is adopted to learn global brain effective connectivity. • Right-lateralized frontotemporal activation and connectivity exist in spatial hearing. Auditory spatial attention detection (ASAD) aims to decipher the spatial locus of a listener's selective auditory attention from electroencephalogram (EEG) signals. However, current models may exhibit deficiencies in EEG feature extraction, leading to overfitting on small datasets or a decline in EEG discriminability. Furthermore, they often neglect topological relationships between EEG channels and, consequently, brain connectivities. Although graph-based EEG modeling has been employed in ASAD, effectively incorporating both local and global connectivities remains a great challenge. To address these limitations, we propose a new ASAD model. First, time-frequency feature fusion provides a more precise and discriminative EEG representation. Second, EEG segments are treated as graphs, and the graph convolution and global attention mechanism are leveraged to capture local and global brain connections, respectively. A series of experiments are conducted in a leave-trials-out cross-validation manner. On the MAD-EEG and KUL datasets, the accuracies of the proposed model are more than 9% and 3% higher than those of the corresponding state-of-the-art models, respectively, while the accuracy of the proposed model on the SNHL dataset is roughly comparable to that of the state-of-the-art model. EEG time-frequency feature fusion proves to be indispensable in the proposed model. EEG electrodes over the frontal cortex are most important for ASAD tasks, followed by those over the temporal lobe. Additionally, the proposed model performs well even on small datasets. This study contributes to a deeper understanding of the neural encoding related to human hearing and attention, with potential applications in neuro-steered hearing devices.

Brain connectivity and time-frequency fusion-based auditory spatial attention detection

Auditory Spatial Attention Detection Based on Feature Disentanglement and Brain Connectivity-Informed Graph Neural Networks

Decoding auditory attention (in real time) with eeg

Subject-independent auditory spatial attention detection based on brain topology modeling and feature distribution alignment

STAnet: A Spatiotemporal Attention Network for Decoding Auditory Spatial Attention from EEG

Detecting the Locus of Auditory Attention Based on the Spectro-Spatial-temporal Analysis of EEG.

A DenseNet-based method for decoding auditory spatial attention with EEG

EEG-Based Fast Auditory Attention Detection in Real-Life Scenarios Using Time-Frequency Attention Mechanism.

EEG-Based Auditory Attention Detection via Frequency and Channel Neural Attention

A Neural-Inspired Architecture for EEG-Based Auditory Attention Detection

Selective auditory attention detection based on effective connectivity by single-trial EEG

Predicting Auditory Spatial Attention from EEG using Single- and Multi-task Convolutional Neural Networks

Auditory Attention Detection via Cross-Modal Attention

EEG-Based Short-Time Auditory Attention Detection Using Multi-Task Deep Learning.

Using Ear-EEG to Decode Auditory Attention in Multiple-speaker Environment

Auditory Attention Detection in Real-Life Scenarios Using Common Spatial Patterns from EEG

Low-latency auditory spatial attention detection based on spectro-spatial features from EEG

Attention-guided graph structure learning network for EEG-enabled auditory attention detection

A Multi-Plane Decoupled Convolutional Network for EEG-Based Auditory Attention Detection

EEG-based Auditory Attention Detection with Spiking Graph Convolutional Network

Fast EEG-Based Decoding Of The Directional Focus Of Auditory Attention Using Common Spatial Patterns