Abstract:Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of heterogeneity commonly found in normal speech including accent or gender, when further compounded with the variability over age and speech pathology severity level, create large diversity among speakers. To this end, speaker adaptation techniques play a key role in personalization of ASR systems for such users. Motivated by the spectro-temporal level differences between dysarthric, elderly and normal speech that systematically manifest in articulatory imprecision, decreased volume and clarity, slower speaking rates and increased dysfluencies, novel spectrotemporal subspace basis deep embedding features derived using SVD speech spectrum decomposition are proposed in this paper to facilitate auxiliary feature based speaker adaptation of state-of-the-art hybrid DNN/TDNN and end-to-end Conformer speech recognition systems. Experiments were conducted on four tasks: the English UASpeech and TORGO dysarthric speech corpora; the English DementiaBank Pitt and Cantonese JCCOCC MoCA elderly speech datasets. The proposed spectro-temporal deep feature adapted systems outperformed baseline i-Vector and xVector adaptation by up to 2.63% absolute (8.63% relative) reduction in word error rate (WER). Consistent performance improvements were retained after model based speaker adaptation using learning hidden unit contributions (LHUC) was further applied. The best speaker adapted system using the proposed spectral basis embedding features produced the lowest published WER of 25.05% on the UASpeech test set of 16 dysarthric speakers.

Robust Speech Recognition Based on Spectral Adjusting and Warping

Channel Adaptation Method Based on Spectral Adjusting for Speech Recognition

Cross-modal Mask Fusion and Modality-Balanced Audio-Visual Speech Recognition

Glottal Information Based Spectral Recuperation in Multi-channel Speaker Recognition

Wavoice: A mmWave-assisted Noise-resistant Speech Recognition SystemJust Accepted

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System.

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System

Multi-Channel Feature Adaptation for Robust Speech Recognition

Robust Automatic Speech Recognition via WavAugment Guided Phoneme Adversarial Training

An Efficient Robust Asr System Based On The Combination Of Speech Enhancement And Hmm Adaptation

Compensation of Speech Enhancement Distortion for Robust Speech Recognition

Speaker Normalization Training and Adaptation for Speech Recognition

Robust MMSE-FW-LAASR Scheme at Low SNRs

VTS-based Robust Speech Recognition

Speaker Adaptation Using Spectro-Temporal Deep Features for Dysarthric and Elderly Speech Recognition

Statistical Thresholding for Robust ASR

Robust speaker recognition using glottal information‐based cepstral mean subtraction

A New Robust Telephone Speech Recognition Algorithm With The Multi-Model Structures

An Algorithm of Model Compensation Based on the Estimation of Additive Noise and Channel Function for Speech Recognition

Noise Robust Speech Recognition Using Multi-Channel Based Channel Selection And ChannelWeighting.

Robust Speaker Recognition in Cross-Channel Condition