Abstract:Nonlinear compensation models make use of a nonlinear mismatch function, which characterizes the joint effects of additive and convolutional noise, to realize noise-robust speech recognition. Representative compensation models consist of vector Taylor series (VTS), data-driven parallel model combination (DPMC), and unscented transform (UT). The noise parameters of the compensation models, often estimated in the maximum likelihood (ML) sense, are known to play an important role on the system performance in noisy conditions. In this paper, we conduct a systematic comparison between two popular approaches for estimating the noise parameters. The first approach employs the Gauss-Newton method in a generalized EM framework to iteratively maximizing the EM auxiliary function. The second approach views the compensation models from a generative perspective, giving rise to an EM algorithm, analogous to the ML estimation for factor analysis (EM-FA). We demonstrate a close connection between these two approaches: they belong to the family of gradient-based methods except with different convergence rates. Note that the convergence property can be crucial to the noise estimation since model compensation may be frequently carried out in changing noisy environments for retaining desired performance. Furthermore, we present an in-depth discussion on the advantages and limitations of the two approaches, and illustrate how to extend these approaches to allow for adaptive training. The investigated noise estimation approaches are evaluated on several tasks. The first is to fit a GMM model to artificially corrupted samples, and then speech recognition are performed on the Aurora 2 and Aurora 4 tasks.

Application of VTS Approximation Based Feature Compensation Approach to Speech Recognition

A Feature Compensation Approach Using High-Order Vector Taylor Series Approximation of an Explicit Distortion Model for Noisy Speech Recognition

An Improved VTS Feature Compensation Using Mixture Models of Distortion and IVN Training for Noisy Speech Recognition

Research on Bandwidth Mismatch Compensation in Speech Recognition

A Feature Compensation Approach Using Piecewise Linear Approximation of an Explicit Distortion Model for Noisy Speech Recognition

Evaluation of a Feature Compensation Approach Using High-Order Vector Taylor Series Approximation of an Explicit Distortion Modelon Aurora2, Aurora3, and Aurora4 Tasks

Using vector taylor series with noise clustering for speech recognition in non-stationary noisy environnlents

A VTS-based Feature Compensation Approach to Noisy Speech Recognition Using Mixture Models of Distortion

An Algorithm of Model Compensation Based on the Estimation of Additive Noise and Channel Function for Speech Recognition

VTS-based Robust Speech Recognition

Ivn-Based Joint Training of Gmm and Hmms Using an Improved Vts-Based Feature Compensation for Noisy Speech Recognition

Combining Eigenvoice Speaker Modeling And Vts-Based Environment Compensation For Robust Speech Recognition

Learning Virtual HD Model for Bi-model Emotional Speaker Recognition

Simplified Deformation Compensation for Emotional Speaker Recognition

ViSPer: A Multilingual TTS Approach Based on VITS Using Deep Feature Loss

Residual noise compensation for robust speech recognition in nonstationary noise

A Comparative Study of Noise Estimation Algorithms for Nonlinear Compensation in Robust Speech Recognition

Channel Compensation Technology In Differential Gsv-Svm Speaker Verification System

Combining Noise Compensation and Missing-Feature Decoding for Large Vocabulary Speech Recognition in Noise

Application of dynamic time warping optimization algorithm in speech recognition of machine translation