Abstract:Objective. Auditory attention decoding (AAD) determines which speaker the listener is focusing on by analyzing his/her EEG. Convolutional neural network (CNN) was adopted to extract spectro-spatial-feature (SSF) from short-time-interval of EEG to detect auditory spatial attention without stimuli. However, the following factors are not considered in SSF-CNN scheme. (a) Single-band frequency analysis cannot represent the EEG pattern precisely. (b) The power cannot represent the EEG feature related to the dynamic patterns of the attended auditory stimulus. (c) The temporal feature of EEG representing the relationship between EEG and attended stimulus is not extracted. To solve these problems, SSF-CNN scheme was modified.Approach. (a) Multiple-frequency bands, but not a single alpha frequency band, of EEG, were analyzed to represent the EEG pattern more precisely. (b) Differential entropy, but not power, was extracted from each frequency band to represent the disorder degree of EEG, which was related to the dynamic patterns of the attended auditory stimulus. (c) CNN and convolutional-long-short-term-memory (ConvLSTM) were combined to extract spectro-spatial-temporal features from the 3D descriptor sequence constructed based on the topographical activity maps of multiple-frequency bands.Main results. Experimental results on KUL, DTU, and PKU with 0.1 s, 1 s, 2 s, and 5 s decision windows demonstrated that: (a) The proposed model outperformed SSF-CNN and state-of-the-art AAD models. Specifically, when the auditory stimulus was unavailable, AAD accuracy could be enhanced by at least3.25%,3.96%and5.08%on KUL, DTU, and PKU, respectively, compared with the baselines. And, on KUL, the longer decision window corresponded to lower enhancement, while on both DTU and PKU, the longer decision window corresponded to higher enhancement, except for two cases when decision window length was 2 s on PKU or 5 s on DTU. (b) Each modification contributed to the performance enhancement.Significance. DE feature, multi-band frequency analysis, and ConvLSTM-based temporal analysis help to enhance AAD accuracy.

Auditory Attention Detection in Real-Life Scenarios Using Common Spatial Patterns from EEG

Decoding auditory attention (in real time) with eeg

Low Latency Auditory Attention Detection with Common Spatial Pattern Analysis of EEG Signals.

EEG-Based Fast Auditory Attention Detection in Real-Life Scenarios Using Time-Frequency Attention Mechanism.

Low-latency auditory spatial attention detection based on spectro-spatial features from EEG

Using Ear-EEG to Decode Auditory Attention in Multiple-speaker Environment

Detecting the Locus of Auditory Attention Based on the Spectro-Spatial-temporal Analysis of EEG.

Auditory Attention Detection via Cross-Modal Attention

A Neural-Inspired Architecture for EEG-Based Auditory Attention Detection

EEG-Based Short-Time Auditory Attention Detection Using Multi-Task Deep Learning.

A DenseNet-based method for decoding auditory spatial attention with EEG

Fast EEG-Based Decoding Of The Directional Focus Of Auditory Attention Using Common Spatial Patterns

Auditory attention detection with EEG channel attention

EEG-Based Auditory Attention Detection via Frequency and Channel Neural Attention

EEG-based Auditory Attention Decoding: Towards Neuro-Steered Hearing Devices

Auditory Attention Decoding in Four-Talker Environment with EEG

A Multi-Plane Decoupled Convolutional Network for EEG-Based Auditory Attention Detection

Auditory attention decoding from electroencephalography based on long short-term memory networks

STAnet: A Spatiotemporal Attention Network for Decoding Auditory Spatial Attention from EEG

A General Common Spatial Patterns for EEG Analysis With Applications to Vigilance Detection

EEG-based auditory attention decoding with audiovisual speech for hearing-impaired listeners