Abstract:Recognizing speech in noise, such as in a busy restaurant, is an essential cognitive skill where the task difficulty varies across environments and noise levels. Although there is growing evidence that the auditory system relies on statistical representations for perceiving and coding natural sounds, it is less clear how statistical cues and neural representations contribute to segregating speech in natural auditory scenes. We demonstrate that human listeners rely on mid-level statistics to segregate and recognize speech in environmental noise. Using natural backgrounds and variants with perturbed spectro-temporal statistics, we show that speech recognition accuracy at a fixed noise level varies extensively across natural backgrounds (0% to 100%). Furthermore, for each background the unique interference created by summary statistics can mask or unmask speech, thus hindering or improving speech recognition. To identify the neural coding strategy and statistical cues that influence accuracy, we developed generalized perceptual regression, a framework that links summary statistics from a neural model to word recognition accuracy. Whereas a peripheral cochlear model accounts for only 60% of perceptual variance, summary statistics from a mid-level auditory midbrain model accurately predicts single trial sensory judgments, accounting for more than 90% of the perceptual variance. Furthermore, perceptual weights from the regression framework identify which statistics and tuned neural filters are influential and how they impact recognition. Thus, perception of speech in natural backgrounds relies on a mid-level auditory representation involving interference of multiple summary statistics that impact recognition beneficially or detrimentally across natural background sounds.

Flooring the observation probability for robust ASR in impulsive noise

Statistical Thresholding for Robust ASR

A Robust Time-frequency Decomposition Model for Suppression of Mixed Gaussian-impulse Noise in Audio Signals

Estimate the noise effect on automatic speech recognition accuracy for mandarin by an approach associating articulation index

Autoregressive Model-Based Robust Speech Recognition in Additive Noise Environment

Robust sparse Bayesian learning for DOA estimation in impulsive noise environments

Weighting Observation Vectors for Robust Speech Recognition in Noisy Environments.

DOA estimation for uncorrelated and coherent signals in impulsive noise

A Novel DOA Estimation Algorithm Based on Robust Mixed Fractional Lower-Order Correntropy in Impulsive Noise

An Impulse Noise Robust Noise Estimation Algorithm Applied For Low Signal-To-Noise Ratio Digital Communication

Revisiting Acoustic Features for Robust ASR

Adaptive Impulsive Noise Suppression: A Deep Learning-Based Parameters Estimation Approach

Analysis of noise robustness of auditory features in speech recognition

Modelling human speech recognition in challenging noise maskers using machine learning

An Auditory Neural Feature Extraction Method for Robust Speech Recognition.

Interference of mid-level sound statistics underlie human speech recognition sensitivity in natural noise

Impulse response estimation for robust speech recognition in a reverberant environment

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

An Auditory System-Based Feature for Robust Speech Recognition.

A Novel Speech/Noise Discrimination Method for Embedded ASR System

Robust Sparse Signal Recovery in Impulsive Noise Using Bayesian Methods