Abstract:In our previous work, we proposed a feature compensation approach using high-order vector Taylor series (VTS) approximation for noisy speech recognition. In this paper, we report new progress on making it more powerful and practical in real applications. First, mixtures of densities are used to enhance the distortion models of both additive noise and convolutional distortion. New formulations for maximum likelihood (ML) estimation of distortion model parameters, and minimum mean squared error (MMSE) estimation of clean speech are derived and presented. Second, we improve the feature compensation in both efficiency and accuracy by applying higher order information of VTS approximation only to the noisy speech mean parameters, and a temporal smoothing operation for the posterior probability of Gaussian mixture components in clean speech estimation. Finally, we design a procedure to perform irrelevant variability normalization (IVN) based joint training of a reference Gaussian mixture model (GMM) for feature compensation and hidden Markov models (HMMs) for acoustic modeling using VTS-based feature compensation. The effectiveness of our proposed approach is confirmed by experiments on Aurora3 benchmark database for a real-world in-vehicle connected digits recognition task. Compared with ETSI advanced front-end, our approach achieves significant recognition accuracy improvement across three “training-testing” conditions for four languages.

Second order vector taylor series based robust speech recognition

Robust Speech Recognition Based on Vector Taylor Series

A Novel Static Parameter Calculation Method For Model Compensation

Robust Speech Recognition Using Improved Vector Taylor Series Algorithm for Embedded Systems

A Feature Compensation Approach Using High-Order Vector Taylor Series Approximation of an Explicit Distortion Model for Noisy Speech Recognition

Application of VTS Approximation Based Feature Compensation Approach to Speech Recognition

VTS-based Robust Speech Recognition

Vts Feature Compensation Based on Two-Layer Gmm Structure for Robust Speech Recognition

Feature Compensation Algorithm Based on Vector Taylor Series for Speaker Recognition

An Improved VTS Feature Compensation Using Mixture Models of Distortion and IVN Training for Noisy Speech Recognition

Using vector taylor series with noise clustering for speech recognition in non-stationary noisy environnlents

Combining Eigenvoice Speaker Modeling And Vts-Based Environment Compensation For Robust Speech Recognition

Evaluation of a Feature Compensation Approach Using High-Order Vector Taylor Series Approximation of an Explicit Distortion Modelon Aurora2, Aurora3, and Aurora4 Tasks

A Novel Dynamic Parameters Calculation Approach for Model Compensation.

Multi-Environment Model Adaptation Based on Vector Taylor Series for Robust Speech Recognition

Towards Robust FastSpeech 2 by Modelling Residual Multimodality

Irrelevant Variability Normalization Based HMM Training Using VTS Approximation of an Explicit Model of Environmental Distortions.

EfficientTTS 2: Variational End-to-End Text-to-Speech Synthesis and Voice Conversion

Cepstral Smoothing of Spectral Masks for Acoustic Vector-Sensor Based Convolutive Speech Separation

Residual Noise Compensation For Robust Speech Recognition In Nonstationary Noise

Recent progress in robust vocabulary-independent speech recognition