Abstract:Objective: This study develops a deep learning method for fast auditory attention decoding (AAD) using electroencephalography (EEG) from listeners with hearing impairment. It addresses three classification tasks: differentiating noise from speech-in-noise, classifying the direction of attended speech (left vs. right) and identifying the activation status of hearing aid noise reduction (NR) algorithms (OFF vs. ON). These tasks contribute to our understanding of how hearing technology influences auditory processing in the hearing-impaired population. Method: Deep convolutional neural network (DCNN) models were designed for each task. Two training strategies were employed to clarify the impact of data splitting on AAD tasks: inter-trial, where the testing set used classification windows from trials that the training set hadn't seen, and intra-trial, where the testing set used unseen classification windows from trials where other segments were seen during training. The models were evaluated on EEG data from 31 participants with hearing impairment, listening to competing talkers amidst background noise. Results: Using 1-second classification windows, DCNN models achieve accuracy (ACC) of 69.8\%, 73.3\% and 82.9\% and area-under-curve (AUC) of 77.2\%, 80.6\% and 92.1\% for the three tasks respectively on inter-trial strategy. In the intra-trial strategy, they achieved ACC of 87.9\%, 80.1\% and 97.5\%, along with AUC of 94.6\%, 89.1\%, and 99.8\%. Our DCNN models show good performance on short 1-second EEG samples, making them suitable for real-world applications. Conclusion: Our DCNN models successfully addressed three tasks with short 1-second EEG windows from participants with hearing impairment, showcasing their potential. While the inter-trial strategy demonstrated promise for assessing AAD, the intra-trial approach yielded inflated results, underscoring the important role of proper data splitting in EEG-based AAD tasks. Significance: Our findings showcase the promising potential of EEG-based tools for assessing auditory attention in clinical contexts and advancing hearing technology, while also promoting further exploration of alternative deep learning architectures and their potential constraints.

Deep Neural Network Based Environment Sound Classification and Its Implementation on Hearing Aid App

Deep Neural Network Based Noised Asian Speech Enhancement and Its Implementation on a Hearing Aid App.

The Application Design of Hearing Aid Parameters Auto Adaptive System for Hearing Impaired Children Based on Android Terminal

Robust Audio Sensing with Multi-Sound Classification.

Binaural Classification for Reverberant Speech Segregation Using Deep Neural Networks

A Comparison of deep learning methods for environmental sound

A Smart Binaural Hearing Aid Architecture Leveraging a Smartphone APP with Deep-Learning Speech Enhancement.

An Ensemble One Dimensional Convolutional Neural Network with Bayesian Optimization for Environmental Sound Classification

Restoring speech intelligibility for hearing aid users with deep learning

Deep learning restores speech intelligibility in multi-talker interference for cochlear implant users

End-to-End Environmental Sound Classification using a 1D Convolutional Neural Network

Hearing-Loss Compensation Using Deep Neural Networks: A Framework and Results From a Listening Test

A Supervised Speech Enhancement Method for Smartphone-Based Binaural Hearing Aids

Improving the Environmental Perception of Autonomous Vehicles using Deep Learning-based Audio Classification

An RNN-based Speech Enhancement Method for a Binaural Hearing Aid System

Deep Denoising for Hearing Aid Applications

Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification

Multi-mode Study of Deep Learning Applications in Acoustic Signal Processing

HASA-Net: A Non-Intrusive Hearing-Aid Speech Assessment Network

Influence of Lossy Speech Codecs on Hearing-aid, Binaural Sound Source Localisation using DNNs

Deep learning-based auditory attention decoding in listeners with hearing impairment