Abstract:Abstract Recent progress in deep learning has revolutionized speech recognition research, with Deep Neural Networks (DNNs) becoming the new state of the art for acoustic modeling. DNNs offer significantly lower speech recognition error rates compared to those provided by the previously used Gaussian Mixture Models (GMMs). Unfortunately, DNNs are data sensitive, and unseen data conditions can deteriorate their performance. Acoustic distortions such as noise, reverberation, channel differences, etc. add variation to the speech signal, which in turn impact DNN acoustic model performance. A straightforward solution to this issue is training the DNN models with these types of variation, which typically provides quite impressive performance. However, anticipating such variation is not always possible; in these cases, DNN recognition performance can deteriorate quite sharply. To avoid subjecting acoustic models to such variation, robust features have traditionally been used to create an invariant representation of the acoustic space. Most commonly, robust feature-extraction strategies have explored three principal areas: (a) enhancing the speech signal, with a goal of improving the perceptual quality of speech; (b) reducing the distortion footprint, with signal-theoretic techniques used to learn the distortion characteristics and subsequently filter them out of the speech signal; and finally (c) leveraging knowledge from auditory neuroscience and psychoacoustics, by using robust features inspired by auditory perception.In this chapter, we present prominent robust feature-extraction strategies explored by the speech recognition research community, and we discuss their relevance to coping with data-mismatch problems in DNN-based acoustic modeling. We present results demonstrating the efficacy of robust features in the new paradigm of DNN acoustic models. And we discuss future directions in feature design for making speech recognition systems more robust to unseen acoustic conditions. Note that the approaches discussed in this chapter focus primarily on single channel data.

Normalized Recognition of Speech and Audio Events

Learning An Invariant Speech Representation

Study of A Novel Key Feature in Non-Cooperative Modulation Automatic Recognition

Affect-Insensitive Speaker Recognition by Feature Variety Training

An invariant convolution model and its Variational Bayesian Approximation approach via Students-t priors for acoustic imaging in colored noises

Variance Normalised Features for Language and Dialect Discrimination

Speech recognition adaptive clustering feature extraction algorithms based on the k-means algorithm and the normalized intra-class variance

Feature Normalisation for Robust Speech Recognition

Discovery and Separation of Features for Invariant Representation Learning

I-vector Dependent Feature Space Transformations for Adaptive Speech Recognition

Measuring invariances in deep networks

Feature Extraction Technique Based on the Perceptive Invariability

Robust Auditory-Based Speech Feature Extraction Using Independent Subspace Method

Audio Bank: A High-Level Acoustic Signal Representation for Audio Event Recognition

Spatiotemporal Phase Congruency Based Invariant Features for Human Behavior Classification

Speech Feature Extraction in Broadcast Hosting Based on Fluctuating Equation Inversion

Invariant feature extraction and classification in kernel spaces

An Improved Locality Preserving Projection For Feature Transform In Speech Recognition

Voice Conversion Based Speaker Normalization for Acoustic Unit Discovery

A robust sparse auditory feature for speaker verification

Robust Features in Deep-Learning-Based Speech Recognition