Abstract:The speech quality delivered by hearing aids plays a crucial role in determining the acceptance and satisfaction of users. Compared with invasive speech quality evaluation methods that require pure signals as a reference, this paper proposes a non-invasive speech quality evaluation algorithm for hearing aids with multi-head self-attention and audiogram-based features. Initially, the audiogram of hearing-impaired individuals is extended along the frequency axis, enabling the speech quality evaluation model to learn the gain requirements specific to frequency bands for hearing-impaired individuals. Subsequently, the spectrogram is extracted from the speech signals to be evaluated. These features are combined with the transformed audiogram to create input features. To extract deep frame-level feature, a network employing multiple two-dimensional convolutional modules is utilized. Then, the temporal features are modeled using bidirectional long short-term memory networks (BiLSTM), while a multi-head self-attention mechanism is employed to integrate contextual information. This mechanism enables the model to focus on key frame information. Experimental results demonstrate that, compared to currently available advanced algorithms, the proposed network exhibits a higher correlation with the Hearing Aid Speech Quality Index (HASQI) and demonstrates robustness under various noise conditions.

A Noise-Robust Feature Extraction Method Based on Auditory Model in Speech Recognition

Auditory Model Based Speech Feature Extraction and Its Application to Speaker Identification

Auditory model-based speech feature extraction and its application to speaker identification

An Auditory Feature Extraction Method Based on Forward-Masking and Its Application in Robust Speaker Identification and Speech Recognition.

Further Feature Extraction and Its Application on Speaker Recognition

A Forward Masking Auditory Model And Its Application In Speaker Identification And Speech Recognition

Noise Estimation Using Mean Square Cross Prediction Error for Speech Enhancement

An Auditory-Based Monaural Feature for Noisy and Reverberant Speech Enhancement

Hybrid Independent Component Analysis and Rough Set Approach for Audio Feature Extraction

A Noise Robust Front End Algorithm for Mandarin Speech Recognition and Performance Analysis

Bionic Cepstral coefficients (BCC): A new auditory feature extraction to noise-robust speaker identification

Autoregressive Model-Based Robust Speech Recognition in Additive Noise Environment

Further Feature Extraction for Speaker Recognition

Robust Front-End for Speech Recognition Based on Computational Auditory Scene Analysis and Speaker Model

Research of Characteristic Parameters Extraction Based on Embedded Speech Recognition System

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

Modified MFCCs for Robust Speaker Recognition

Multi-resolution Time Frequency Feature and Complementary Combination for Short Utterance Speaker Recognition

Research on Speech Recognition Methods Based on Spectral Subtraction and Improved BP Neural Network Algorithm

A non-invasive speech quality evaluation algorithm for hearing aids with multi-head self-attention and audiogram-based features

Research and Prospect on Robustness Technology in Real-environment Speech Recognition