Abstract:Humans are able to identify and track a target speaker amid a cacophony of acoustic interference, an ability which is often referred to as the cocktail party phenomenon. Results from several decades of studying this phenomenon have culminated in recent years in various promising attempts to decode the attentional state of a listener in a competing-speaker environment from non-invasive neuroimaging recordings such as magnetoencephalography (MEG) and electroencephalography (EEG). To this end, most existing approaches compute correlation-based measures by either regressing the features of each speech stream to the M/EEG channels (the decoding approach) or vice versa (the encoding approach). To produce robust results, these procedures require multiple trials for training purposes. Also, their decoding accuracy drops significantly when operating at high temporal resolutions. Thus, they are not well-suited for emerging real-time applications such as smart hearing aid devices or brain-computer interface systems, where training data might be limited and high temporal resolutions are desired. In this paper, we close this gap by developing an algorithmic pipeline for real-time decoding of the attentional state. Our proposed framework consists of three main modules: (1) Real-time and robust estimation of encoding or decoding coefficients, achieved by sparse adaptive filtering, (2) Extracting reliable markers of the attentional state, and thereby generalizing the widely-used correlation-based measures thereof, and (3) Devising a near real-time state-space estimator that translates the noisy and variable attention markers to robust and statistically interpretable estimates of the attentional state with minimal delay. Our proposed algorithms integrate various techniques including forgetting factor-based adaptive filtering, ℓ<sub>1</sub>-regularization, forward-backward splitting algorithms, fixed-lag smoothing, and Expectation Maximization. We validate the performance of our proposed framework using comprehensive simulations as well as application to experimentally acquired M/EEG data. Our results reveal that the proposed real-time algorithms perform nearly as accurately as the existing state-of-the-art offline techniques, while providing a significant degree of adaptivity, statistical robustness, and computational savings.

Decoding the cognitive states of attention and distraction in a real-life setting using EEG

Decoding auditory attention (in real time) with eeg

Decoding Attentional State to Faces and Scenes Using EEG Brainwaves

Detecting driver distraction using stimuli-response EEG analysis

Sustained Attention States Recognition with EEG and Eye-Tracking in the GradCPT.

Neural Dynamics of Target Detection via Wireless EEG in Embodied Cognition

Real-time estimation of EEG-based engagement in different tasks

EEG-based Assessment of Long-Term Vigilance and Lapses of Attention using a User-Centered Frequency-Tagging Approach

Assessing focus through ear-EEG: a comparative study between conventional cap EEG and mobile in- and around-the-ear EEG systems

Mind wandering state detection during video-based learning via EEG.

Real-Time Tracking of Selective Auditory Attention From M/EEG: A Bayesian Filtering Approach

EEG-Based Attention Tracking During Distracted Driving.

Decoding Selective Attention and Cognitive Control Processing Through Stroop Interference Effect: An Event-Related Electroencephalography-Derived Study

AttentioNet: Monitoring Student Attention Type in Learning with EEG-Based Measurement System

Multi-Scale EEG Brain Dynamics During Sustained Attention Tasks

Deep Learning-based EEG Detection of Mental Alertness States from Drivers under Ethical Aspects.

EEG Based Driver Inattention Identification via Feature Profiling and Dimensionality Reduction

A Noninvasive Real-Time Driving Fatigue Detection Technology Based on Left Prefrontal Attention and Meditation EEG

EEG-Based Attention Feedback to Improve Focus in E-Learning

Predicting Attentional Focus: Heartbeat-Evoked Responses and Brain Dynamics During Interoceptive and Exteroceptive Information Processing

EEG predictors of covert vigilant attention