Abstract:In our previous work, we proposed a feature compensation approach using high-order vector Taylor series (VTS) approximation for noisy speech recognition. In this paper, we report new progress on making it more powerful and practical in real applications. First, mixtures of densities are used to enhance the distortion models of both additive noise and convolutional distortion. New formulations for maximum likelihood (ML) estimation of distortion model parameters, and minimum mean squared error (MMSE) estimation of clean speech are derived and presented. Second, we improve the feature compensation in both efficiency and accuracy by applying higher order information of VTS approximation only to the noisy speech mean parameters, and a temporal smoothing operation for the posterior probability of Gaussian mixture components in clean speech estimation. Finally, we design a procedure to perform irrelevant variability normalization (IVN) based joint training of a reference Gaussian mixture model (GMM) for feature compensation and hidden Markov models (HMMs) for acoustic modeling using VTS-based feature compensation. The effectiveness of our proposed approach is confirmed by experiments on Aurora3 benchmark database for a real-world in-vehicle connected digits recognition task. Compared with ETSI advanced front-end, our approach achieves significant recognition accuracy improvement across three “training-testing” conditions for four languages.

An Improved VTS Feature Compensation Using Mixture Models of Distortion and IVN Training for Noisy Speech Recognition

A VTS-based Feature Compensation Approach to Noisy Speech Recognition Using Mixture Models of Distortion

A Feature Compensation Approach Using High-Order Vector Taylor Series Approximation of an Explicit Distortion Model for Noisy Speech Recognition

Ivn-Based Joint Training of Gmm and Hmms Using an Improved Vts-Based Feature Compensation for Noisy Speech Recognition

Application of VTS Approximation Based Feature Compensation Approach to Speech Recognition

Evaluation of a Feature Compensation Approach Using High-Order Vector Taylor Series Approximation of an Explicit Distortion Modelon Aurora2, Aurora3, and Aurora4 Tasks

A Feature Compensation Approach Using Piecewise Linear Approximation of an Explicit Distortion Model for Noisy Speech Recognition

Irrelevant Variability Normalization Based HMM Training Using VTS Approximation of an Explicit Model of Environmental Distortions.

Vts Feature Compensation Based on Two-Layer Gmm Structure for Robust Speech Recognition

Noise adaptive front-end normalization based on Vector Taylor Series for Deep Neural Networks in robust speech recognition

Feature Compensation Algorithm Based on Vector Taylor Series for Speaker Recognition

VTS-based Robust Speech Recognition

Speech-enhanced and Noise-aware Networks for Robust Speech Recognition

An HMM Compensatioon Approach for Dynamic Features Using Unscented Transformation and Its Application to Noisy Speech Recognition

Combining Eigenvoice Speaker Modeling And Vts-Based Environment Compensation For Robust Speech Recognition

Robust Speech Recognition Based on Vector Taylor Series

HMM compensation based on non-uniform spectral compression for noisy speech recognition

Combining Noise Compensation and Missing-Feature Decoding for Large Vocabulary Speech Recognition in Noise

Two-stage model-based feature compensation for robust speech recognition

Using vector taylor series with noise clustering for speech recognition in non-stationary noisy environnlents

Combining Log-Spectral Domain Compensation with MVA Feature Post-Processing for Robust Speech Recognition