Abstract:Highlights • We propose a model to detect the spatial locus of a listener's auditory attention. • EEG is modeled as a graph with node features based on time-frequency feature fusion. • Graph convolution can take advantage of local brain neuroanatomical connectivity. • Global attention mechanism is adopted to learn global brain effective connectivity. • Right-lateralized frontotemporal activation and connectivity exist in spatial hearing. Auditory spatial attention detection (ASAD) aims to decipher the spatial locus of a listener's selective auditory attention from electroencephalogram (EEG) signals. However, current models may exhibit deficiencies in EEG feature extraction, leading to overfitting on small datasets or a decline in EEG discriminability. Furthermore, they often neglect topological relationships between EEG channels and, consequently, brain connectivities. Although graph-based EEG modeling has been employed in ASAD, effectively incorporating both local and global connectivities remains a great challenge. To address these limitations, we propose a new ASAD model. First, time-frequency feature fusion provides a more precise and discriminative EEG representation. Second, EEG segments are treated as graphs, and the graph convolution and global attention mechanism are leveraged to capture local and global brain connections, respectively. A series of experiments are conducted in a leave-trials-out cross-validation manner. On the MAD-EEG and KUL datasets, the accuracies of the proposed model are more than 9% and 3% higher than those of the corresponding state-of-the-art models, respectively, while the accuracy of the proposed model on the SNHL dataset is roughly comparable to that of the state-of-the-art model. EEG time-frequency feature fusion proves to be indispensable in the proposed model. EEG electrodes over the frontal cortex are most important for ASAD tasks, followed by those over the temporal lobe. Additionally, the proposed model performs well even on small datasets. This study contributes to a deeper understanding of the neural encoding related to human hearing and attention, with potential applications in neuro-steered hearing devices.

Auditory Spatial Attention Detection Based on Feature Disentanglement and Brain Connectivity-Informed Graph Neural Networks

Subject-independent auditory spatial attention detection based on brain topology modeling and feature distribution alignment

Brain connectivity and time-frequency fusion-based auditory spatial attention detection

Attention-guided graph structure learning network for EEG-enabled auditory attention detection

A DenseNet-based method for decoding auditory spatial attention with EEG

EEG-based Auditory Attention Detection with Spiking Graph Convolutional Network

STAnet: A Spatiotemporal Attention Network for Decoding Auditory Spatial Attention from EEG

Selective auditory attention detection based on effective connectivity by single-trial EEG

EEG-Based Auditory Attention Detection via Frequency and Channel Neural Attention

Detecting the Locus of Auditory Attention Based on the Spectro-Spatial-temporal Analysis of EEG.

A Multi-Plane Decoupled Convolutional Network for EEG-Based Auditory Attention Detection

Exploring Brain Connectivity with Spatial-Temporal Graph Neural Networks for Improved EEG Seizure Analysis.

DGSD: Dynamical Graph Self-Distillation for EEG-Based Auditory Spatial Attention Detection

A Neural-Inspired Architecture for EEG-Based Auditory Attention Detection

A Graph Attention Neural Network for Diagnosing ASD with fMRI Data

Predicting Auditory Spatial Attention from EEG using Single- and Multi-task Convolutional Neural Networks

Music-oriented Auditory Attention Detection from Electroencephalogram.

EEG-Based Fast Auditory Attention Detection in Real-Life Scenarios Using Time-Frequency Attention Mechanism.

Auditory Attention Detection via Cross-Modal Attention

Using Ear-EEG to Decode Auditory Attention in Multiple-speaker Environment

A Biologically Inspired Attention Network for EEG-Based Auditory Attention Detection