Abstract:Traditionally, speech quality evaluation relies on subjective assessments or intrusive methods that require reference signals or additional equipment. However, over recent years, non-intrusive speech quality assessment has emerged as a promising alternative, capturing much attention from researchers and industry professionals. This article presents a deep learning-based method that exploits large-scale intrusive simulated data to improve the accuracy and generalization of non-intrusive methods. The major contributions of this article are as follows. First, it presents a data simulation method, which generates degraded speech signals and labels their speech quality with the perceptual objective listening quality assessment (POLQA). The generated data is proven to be useful for pretraining the deep learning models. Second, it proposes to apply an adversarial speaker classifier to reduce the impact of speaker-dependent information on speech quality evaluation. Third, an autoencoder-based deep learning scheme is proposed following the principle of representation learning and adversarial training (AT) methods, which is able to transfer the knowledge learned from a large amount of simulated speech data labeled by POLQA. With the help of discriminative representations extracted from the autoencoder, the prediction model can be trained well on a relatively small amount of speech data labeled through subjective listening tests. Fourth, an end-to-end speech quality evaluation neural network is developed, which takes magnitude and phase spectral features as its inputs. This phase-aware model is more accurate than the model using only the magnitude spectral features. A large number of experiments are carried out with three datasets: one simulated with labels obtained using POLQA and two recorded with labels obtained using subjective listening tests. The results show that the presented phase-aware method improves the performance of the baseline model and the proposed model with latent representations extracted from the adversarial autoencoder (AAE) outperforms the state-of-the-art objective quality assessment methods, reducing the root mean square error (RMSE) by 10.5% and 12.2% on the Beijing Institute of Technology (BIT) dataset and Tencent Corpus, respectively. The code and supplementary materials are available at https://github.com/liushenme/AAE-SQA.

Speakers-Used as sensors for detecting acoustic loads with artificial intelligence

AUDIOSENSE: Leveraging Current to Acoustic Channel to Detect Appliances at Single-Point

Employing Deep Learning Model to Evaluate Speech Information in Acoustic Simulations of Auditory Implants

Speaker Distance Estimation in Enclosures from Single-Channel Audio

Joint Blind Room Acoustic Characterization From Speech And Music Signals Using Convolutional Recurrent Neural Networks

AI-IoT Platform for Blind Estimation of Room Acoustic Parameters Based on Deep Neural Networks

Preliminary results of classifying otosclerosis and disarticulation using a convolutional neural network trained with simulated wideband acoustic immittance data

Deep learning restores speech intelligibility in multi-talker interference for cochlear implant users

Evaluating the Diagnostic Potential of Connected Speech for Benign Laryngeal Disease Using Deep Learning Analysis

Using deep learning to improve the intelligibility of a target speaker in noisy multi-talker environments for people with normal hearing and hearing loss

Toward smart acoustic spaces: embedded machine learning for sound event detection and classification in the built environment

Using audio content and emotional response to predict soundscape perception through machine learning

Room dimensions and absorption inference from room transfer function via machine learning

EarSpy: Spying Caller Speech and Identity through Tiny Vibrations of Smartphone Ear Speakers

CoPlay: Audio-agnostic Cognitive Scaling for Acoustic Sensing

Modelling human speech recognition in challenging noise maskers using machine learning

Artificial Intelligence for road quality assessment in smart cities: a machine learning approach to acoustic data analysis

Objective speech intelligibility prediction using a deep learning model with continuous speech-evoked cortical auditory responses

Robust Speaker Identification Using An Auditory-Based Feature

Non-Intrusive Speech Quality Assessment Based on Deep Neural Networks for Speech Communication

Speakersense: Energy Efficient Unobtrusive Speaker Identification On Mobile Phones