Abstract:In our previous work, we proposed a feature compensation approach using high-order vector Taylor series (VTS) approximation for noisy speech recognition. In this paper, we report new progress on making it more powerful and practical in real applications. First, mixtures of densities are used to enhance the distortion models of both additive noise and convolutional distortion. New formulations for maximum likelihood (ML) estimation of distortion model parameters, and minimum mean squared error (MMSE) estimation of clean speech are derived and presented. Second, we improve the feature compensation in both efficiency and accuracy by applying higher order information of VTS approximation only to the noisy speech mean parameters, and a temporal smoothing operation for the posterior probability of Gaussian mixture components in clean speech estimation. Finally, we design a procedure to perform irrelevant variability normalization (IVN) based joint training of a reference Gaussian mixture model (GMM) for feature compensation and hidden Markov models (HMMs) for acoustic modeling using VTS-based feature compensation. The effectiveness of our proposed approach is confirmed by experiments on Aurora3 benchmark database for a real-world in-vehicle connected digits recognition task. Compared with ETSI advanced front-end, our approach achieves significant recognition accuracy improvement across three “training-testing” conditions for four languages.

Compensation Of Partly Reliable Components For Band-Limited Speech Recognition With Missing Data Techniques

Research on Bandwidth Mismatch Compensation in Speech Recognition

Glottal Information Based Spectral Recuperation in Multi-channel Speaker Recognition

Improve Speech Enhancement Using Perception-High-Related Time-Frequency Loss.

Relative Mel-Frequency Cepstral Coefficients Compensation for Robust Telephone Speech Recognition.

Robust telephone speech recognition based on channel compensation

CHANNEL COMPENSATION OF TELEPHONE SPEECH RECOGNITION BASED ON MFCCs FILTERING

Channel Compensation for Robust Telephone Speech Recognition

Replacing Uncertainty Decoding with Subband Re-Estimation for Large Vocabulary Speech Recognition in Noise.

A Feature Compensation Approach Using Piecewise Linear Approximation of an Explicit Distortion Model for Noisy Speech Recognition

Short Utterance Speaker Recognition Based on Speech High Frequency Information Compensation and Dynamic Feature Enhancement Methods

Sparse Channel Estimation for Filtered Multi-Tone in Time Domain and Subband Domain Based on Matched Filtering Demodulation.

Robust Speech Recognition by Selecting Mel-Filter Banks

Compensation of Speech Enhancement Distortion for Robust Speech Recognition

Application of VTS Approximation Based Feature Compensation Approach to Speech Recognition

An Improved VTS Feature Compensation Using Mixture Models of Distortion and IVN Training for Noisy Speech Recognition

Distortionless Multi-Channel Target Speech Enhancement for Overlapped Speech Recognition

A Feature Compensation Approach Using High-Order Vector Taylor Series Approximation of an Explicit Distortion Model for Noisy Speech Recognition

Ivn-Based Joint Training of Gmm and Hmms Using an Improved Vts-Based Feature Compensation for Noisy Speech Recognition

Robust Speaker Recognition in Cross-Channel Condition

A VTS-based Feature Compensation Approach to Noisy Speech Recognition Using Mixture Models of Distortion