Abstract:Highlights • We propose a model to detect the spatial locus of a listener's auditory attention. • EEG is modeled as a graph with node features based on time-frequency feature fusion. • Graph convolution can take advantage of local brain neuroanatomical connectivity. • Global attention mechanism is adopted to learn global brain effective connectivity. • Right-lateralized frontotemporal activation and connectivity exist in spatial hearing. Auditory spatial attention detection (ASAD) aims to decipher the spatial locus of a listener's selective auditory attention from electroencephalogram (EEG) signals. However, current models may exhibit deficiencies in EEG feature extraction, leading to overfitting on small datasets or a decline in EEG discriminability. Furthermore, they often neglect topological relationships between EEG channels and, consequently, brain connectivities. Although graph-based EEG modeling has been employed in ASAD, effectively incorporating both local and global connectivities remains a great challenge. To address these limitations, we propose a new ASAD model. First, time-frequency feature fusion provides a more precise and discriminative EEG representation. Second, EEG segments are treated as graphs, and the graph convolution and global attention mechanism are leveraged to capture local and global brain connections, respectively. A series of experiments are conducted in a leave-trials-out cross-validation manner. On the MAD-EEG and KUL datasets, the accuracies of the proposed model are more than 9% and 3% higher than those of the corresponding state-of-the-art models, respectively, while the accuracy of the proposed model on the SNHL dataset is roughly comparable to that of the state-of-the-art model. EEG time-frequency feature fusion proves to be indispensable in the proposed model. EEG electrodes over the frontal cortex are most important for ASAD tasks, followed by those over the temporal lobe. Additionally, the proposed model performs well even on small datasets. This study contributes to a deeper understanding of the neural encoding related to human hearing and attention, with potential applications in neuro-steered hearing devices.

EEG-Based Fast Auditory Attention Detection in Real-Life Scenarios Using Time-Frequency Attention Mechanism.

Decoding auditory attention (in real time) with eeg

Auditory Attention Detection in Real-Life Scenarios Using Common Spatial Patterns from EEG

Auditory attention detection with EEG channel attention

EEG-Based Auditory Attention Detection via Frequency and Channel Neural Attention

EEG-Based Short-Time Auditory Attention Detection Using Multi-Task Deep Learning.

Detecting the Locus of Auditory Attention Based on the Spectro-Spatial-temporal Analysis of EEG.

Auditory Attention Detection via Cross-Modal Attention

Using Ear-EEG to Decode Auditory Attention in Multiple-speaker Environment

A Neural-Inspired Architecture for EEG-Based Auditory Attention Detection

Low Latency Auditory Attention Detection with Common Spatial Pattern Analysis of EEG Signals.

A Multi-Plane Decoupled Convolutional Network for EEG-Based Auditory Attention Detection

Brain connectivity and time-frequency fusion-based auditory spatial attention detection

EEG-Derived Voice Signature for Attended Speaker Detection

Esaa: An Eeg-Speech Auditory Attention Detection Database

A Biologically Inspired Attention Network for EEG-Based Auditory Attention Detection

Fast EEG-Based Decoding Of The Directional Focus Of Auditory Attention Using Common Spatial Patterns

Auditory Attention Decoding in Four-Talker Environment with EEG

Auditory attention decoding from electroencephalography based on long short-term memory networks

Music-oriented Auditory Attention Detection from Electroencephalogram.

Low-latency auditory spatial attention detection based on spectro-spatial features from EEG