Abstract:Lightweight speaker-dependent (SD) automatic speech recognition (ASR) is a promising solution for the problems of possibility of disclosing personal privacy and difficulty of obtaining training material for many seldom used English words and (often non-English) names. Dynamic time warping (DTW) algorithm is the state-of-the-art algorithm for small foot-print SD ASR applications, which have limited storage space and small vocabulary. In our previous work, we have successfully developed two fast and accurate DTW variations for clean speech data. However, speech recognition in adverse conditions is still a big challenge. In order to improve recognition accuracy in noisy and bad recording conditions, such as too high or low recording volume, we introduce a novel weighted DTW method. This method defines a feature index for each time frame of training data, and then applies it to the core DTW process to tune the final alignment score. With extensive experiments on one representative SD dataset of three speakers' recordings, our method achieves better accuracy than DTW, where 0.5% relative reduction of error rate (RRER) on clean speech data and 7.5% RRER on noisy and bad recording speech data.To the best of our knowledge, our new weighted DTW is the first weighted DTW method specially designed for speech data in noisy and bad recording conditions.

Reference Point Alignment Frequency Warpmethod For Speaker Adaptation

Reference Point Alignment Frequency Warp Method for Speaker Adaptation

Pitch mean based frequency warping

Speaker adaptation based on combination of MAP estimation and weighted neighbor regression

Frequency Domain Correspondence For Speaker Normalization

Speaker Adaptation with MAP Estimation and Weighted Neighbor Regression

Reference-Based Speech Enhancement Via Feature Alignment and Fusion Network

A New Subspace Based Speaker Adaptation Method

Robust Speech Recognition Based on Spectral Adjusting and Warping

Online Speaker Adaptation for WaveNet-based Neural Vocoders

Speaker Adaptation for Telephony Data Using Speaker Clustering

Phoneme Dependent Speaker Embedding And Model Factorization For Multi-Speaker Speech Synthesis And Adaptation

Speech Recognition Using Speaker Adaptation by System Parameter Transformation.

Spoken Content and Voice Factorization for Few-Shot Speaker Adaptation

Speaker adaptation method using principal curves algorithm

Dynamic Speaker Representations Adjustment and Decoder Factorization for Speaker Adaptation in End-to-End Speech Synthesis

Speaker-independent Training and Adaptation of Neural Vocoders

A Frequency Compensation Method to Smooth Frequency Fluctuation for Locating Moving Acoustic Sources

A Novel Weighted Dynamic Time Warping for Light Weight Speaker-Dependent Speech Recognition in Noisy and Bad Recording Conditions

Design and implementation of speech recognition algorithm based on frequency range

A Permutation Algorithm Based on Dynamic Time Warping in Speech Frequency-Domain Blind Source Separation