Abstract:Abstract Recent progress in deep learning has revolutionized speech recognition research, with Deep Neural Networks (DNNs) becoming the new state of the art for acoustic modeling. DNNs offer significantly lower speech recognition error rates compared to those provided by the previously used Gaussian Mixture Models (GMMs). Unfortunately, DNNs are data sensitive, and unseen data conditions can deteriorate their performance. Acoustic distortions such as noise, reverberation, channel differences, etc. add variation to the speech signal, which in turn impact DNN acoustic model performance. A straightforward solution to this issue is training the DNN models with these types of variation, which typically provides quite impressive performance. However, anticipating such variation is not always possible; in these cases, DNN recognition performance can deteriorate quite sharply. To avoid subjecting acoustic models to such variation, robust features have traditionally been used to create an invariant representation of the acoustic space. Most commonly, robust feature-extraction strategies have explored three principal areas: (a) enhancing the speech signal, with a goal of improving the perceptual quality of speech; (b) reducing the distortion footprint, with signal-theoretic techniques used to learn the distortion characteristics and subsequently filter them out of the speech signal; and finally (c) leveraging knowledge from auditory neuroscience and psychoacoustics, by using robust features inspired by auditory perception.In this chapter, we present prominent robust feature-extraction strategies explored by the speech recognition research community, and we discuss their relevance to coping with data-mismatch problems in DNN-based acoustic modeling. We present results demonstrating the efficacy of robust features in the new paradigm of DNN acoustic models. And we discuss future directions in feature design for making speech recognition systems more robust to unseen acoustic conditions. Note that the approaches discussed in this chapter focus primarily on single channel data.

Learning Dynamic Features with Neural Networks for Phoneme Recognition

Fast learning algorithms for time-delay neural networks phoneme recognition

Dynamic Multi-scale Convolution for Dialect Identification

Dynamic TF-TDNN: Dynamic Time Delay Neural Network Based on Temporal-Frequency Attention for Dialect Recognition

A Fast Learning Algorithm Of Neural Network For The Training And Recognition Of The Phonemes

Deep joint learning for language recognition

Time-Frequency Cepstral Features and Combining Discriminative Training for Phonotactic Language Recognition

New Neural Network Architecture with Application in Mandarin Digit Speech Recognition

A Fast Learning Algorithm for Time-Delay Neural Networks

Phonetic Temporal Neural Model for Language Identification

A Dynamic Neural Network for Syllable Recognition.

A New Neural Network Oriented Speech Recognition

Dynamic noise aware training for speech enhancement based on deep neural networks.

Boosting Dnn-Based Speech Enhancement Via Explicit Transformations

Structured Discriminative Models Using Deep Neural-Network Features.

Local trajectory based speech enhancement for robust speech recognition with deep neural network

Deep Neural Network-based Mixed Speech Recognition Technology for Chinese and English

Phonotactic language recognition based on DNN-HMM acoustic model

Contrastive Auto-Encoder for Phoneme Recognition.

Improved high efficiency Dynamic Time Warping for speech recognition

Robust Features in Deep-Learning-Based Speech Recognition