Study of cognitive component of auditory attention to natural speech events

Nhan D. T. Nguyen,Kaare Mikkelsen,Preben Kidmose
2023-12-19
Abstract:Event-related potentials (ERP) have been used to address a wide range of research questions in neuroscience and cognitive psychology including selective auditory attention. The recent progress in auditory attention decoding (AAD) methods is based on algorithms that find a relation between the audio envelope and the neurophysiological response. The most popular approach is based on the reconstruction of the audio envelope based on EEG signals. However, these methods are mainly based on the neurophysiological entrainment to physical attributes of the sensory stimulus and are generally limited by a long detection window. This study proposes a novel approach to auditory attention decoding by looking at higher-level cognitive responses to natural speech. To investigate if natural speech events elicit cognitive ERP components and how these components are affected by attention mechanisms, we designed a series of four experimental paradigms with increasing complexity: a word category oddball paradigm, a word category oddball paradigm with competing speakers, and competing speech streams with and without specific targets. We recorded the electroencephalogram (EEG) from 32 scalp electrodes and 12 in-ear electrodes (ear-EEG) from 24 participants. A cognitive ERP component, which we believe is related to the well-known P3b component, was observed at parietal electrode sites with a latency of approximately 620 ms. The component is statistically most significant for the simplest paradigm and gradually decreases in strength with increasing complexity of the paradigm. We also show that the component can be observed in the in-ear EEG signals by using spatial filtering. The cognitive component elicited by auditory attention may contribute to decoding auditory attention from electrophysiological recordings and its presence in the ear-EEG signals is promising for future applications within hearing aids.
Neurons and Cognition,Signal Processing
What problem does this paper attempt to address?
The paper aims to study the cognitive components of auditory attention in natural language events. Specifically, the authors attempt to address the following questions: 1. **Investigate whether natural language events can elicit cognitive ERP components**: By designing a series of experimental paradigms (ranging from simple word classification to complex multi-speaker competitive streams), the researchers aim to verify whether natural language events can trigger cognitive ERP components related to attention mechanisms. 2. **Evaluate how these cognitive ERP components are influenced by attention mechanisms**: As the complexity of the experimental paradigms increases, the researchers observe the changes in cognitive ERP components under different conditions, particularly focusing on the variations of these components with different allocations of attention. 3. **Explore the potential of ear-EEG signals in decoding auditory attention**: In addition to traditional scalp EEG recordings, the study also utilizes ear-EEG recordings to detect cognitive ERP components, assessing their feasibility in practical applications (such as hearing aids). In summary, the main goal of this paper is to identify cognitive ERP components related to auditory attention in natural language environments, to explore their performance in tasks of varying complexity, and to determine whether they can be effectively captured through ear-EEG signals. This aims to provide theoretical support and technical foundation for the development of future hearing aid devices.