Abstract:In our previous work, we proposed a feature compensation approach using high-order vector Taylor series (VTS) approximation for noisy speech recognition. In this paper, we report new progress on making it more powerful and practical in real applications. First, mixtures of densities are used to enhance the distortion models of both additive noise and convolutional distortion. New formulations for maximum likelihood (ML) estimation of distortion model parameters, and minimum mean squared error (MMSE) estimation of clean speech are derived and presented. Second, we improve the feature compensation in both efficiency and accuracy by applying higher order information of VTS approximation only to the noisy speech mean parameters, and a temporal smoothing operation for the posterior probability of Gaussian mixture components in clean speech estimation. Finally, we design a procedure to perform irrelevant variability normalization (IVN) based joint training of a reference Gaussian mixture model (GMM) for feature compensation and hidden Markov models (HMMs) for acoustic modeling using VTS-based feature compensation. The effectiveness of our proposed approach is confirmed by experiments on Aurora3 benchmark database for a real-world in-vehicle connected digits recognition task. Compared with ETSI advanced front-end, our approach achieves significant recognition accuracy improvement across three “training-testing” conditions for four languages.

VTS-based Robust Speech Recognition

Using vector taylor series with noise clustering for speech recognition in non-stationary noisy environnlents

An Improved VTS Feature Compensation Using Mixture Models of Distortion and IVN Training for Noisy Speech Recognition

Residual Noise Compensation For Robust Speech Recognition In Nonstationary Noise

Combining Eigenvoice Speaker Modeling And Vts-Based Environment Compensation For Robust Speech Recognition

A VTS-based Feature Compensation Approach to Noisy Speech Recognition Using Mixture Models of Distortion

Autoregressive Model-Based Robust Speech Recognition in Additive Noise Environment

Application of VTS Approximation Based Feature Compensation Approach to Speech Recognition

Statistical Thresholding for Robust ASR

Weighting Observation Vectors for Robust Speech Recognition in Noisy Environments.

A New Robust Telephone Speech Recognition Algorithm With The Multi-Model Structures

Robust Speech Recognition Based on Neighborhood Space

Transfer Learning for Acoustic Modeling of Noise Robust Speech Recognition

A Feature Compensation Approach Using High-Order Vector Taylor Series Approximation of an Explicit Distortion Model for Noisy Speech Recognition

Stereo Hidden Markov Modeling for Noise Robust Speech Recognition

Speech recognition based on relevance vector machine

Robust speech recognition in noisy backgrounds based on Teager energy operator and auditory process

Fuzzy Clustering and Bayesian Information Criterion Based Threshold Estimation for Robust Voice Activity Detection.

Robust Speech Recognition Based on Spectral Adjusting and Warping

Robust Front-End for Speech Recognition Based on Computational Auditory Scene Analysis and Speaker Model