Abstract:Automatic Speech Recognition (ASR) systems must be robust to the myriad types of noises present in real-world environments including environmental noise, room impulse response, special effects as well as attacks by malicious actors (adversarial attacks). Recent works seek to improve accuracy and robustness by developing novel Deep Neural Networks (DNNs) and curating diverse training datasets for them, while using relatively simple acoustic features. While this approach improves robustness to the types of noise present in the training data, it confers limited robustness against unseen noises and negligible robustness to adversarial attacks. In this paper, we revisit the approach of earlier works that developed acoustic features inspired by biological auditory perception that could be used to perform accurate and robust ASR. In contrast, Specifically, we evaluate the ASR accuracy and robustness of several biologically inspired acoustic features. In addition to several features from prior works, such as gammatone filterbank features (GammSpec), we also propose two new acoustic features called frequency masked spectrogram (FreqMask) and difference of gammatones spectrogram (DoGSpec) to simulate the neuro-psychological phenomena of frequency masking and lateral suppression. Experiments on diverse models and datasets show that (1) DoGSpec achieves significantly better robustness than the highly popular log mel spectrogram (LogMelSpec) with minimal accuracy degradation, and (2) GammSpec achieves better accuracy and robustness to non-adversarial noises from the Speech Robust Bench benchmark, but it is outperformed by DoGSpec against adversarial attacks.

Robust Speech Recognition by Selecting Mel-Filter Banks

Robust Log-Energy Estimation and Its Dynamic Change Enhancement for In-car Speech Recognition

Robust speech recognition in noisy backgrounds based on Teager energy operator and auditory process

Design and implementation of speech recognition algorithm based on frequency range

dMel: Speech Tokenization made Simple

Mel-FullSubNet: Mel-Spectrogram Enhancement for Improving Both Speech Quality and ASR

Sub-band Based Log-Energy and Its Dynamic Range Stretching for Robust In-Car Speech Recognition

Choice of Mel Filter Bank in Computing MFCC of a Resampled Speech

Modified Mel Filter Bank to Compute MFCC of Subsampled Speech

Relative Mel-Frequency Cepstral Coefficients Compensation for Robust Telephone Speech Recognition.

Energy-efficient MFCC Extraction Architecture in Mixed-Signal Domain for Automatic Speech Recognition

A filter constructed from estimation of clean speech and noise for speech enhancement in speech recognition systems

Revisiting Acoustic Features for Robust ASR

Statistical Thresholding for Robust ASR

Auditory Features Based on Gammatone Filters for Robust Speech Recognition.

High Performance Digit Mandarin Speech Recognition

Research of Characteristic Parameters Extraction Based on Embedded Speech Recognition System

Modified MFCCs for Robust Speaker Recognition

Robust Audio-Visual Mandarin Speech Recognition Based on Adaptive Decision Fusion and Tone Features

Improving Robustness of Deep Neural Network Acoustic Models via Speech Separation and Joint Adaptive Training

Harmonic Intensity Feature for Robust Speech Recognition