Abstract:Children speech recognition is challenging mainly due to the inherent high variability in children's physical and articulatory characteristics and expressions. This variability manifests in both acoustic constructs and linguistic usage due to the rapidly changing developmental stage in children's life. Part of the challenge is due to the lack of large amounts of available children speech data for efficient modeling. This work attempts to address the key challenges using transfer learning from adult's models to children's models in a Deep Neural Network (DNN) framework for children's Automatic Speech Recognition (ASR) task evaluating on multiple children's speech corpora with a large vocabulary. The paper presents a systematic and an extensive analysis of the proposed transfer learning technique considering the key factors affecting children's speech recognition from prior literature. Evaluations are presented on (i) comparisons of earlier GMM-HMM and the newer DNN Models, (ii) effectiveness of standard adaptation techniques versus transfer learning, (iii) various adaptation configurations in tackling the variabilities present in children speech, in terms of (a) acoustic spectral variability, and (b) pronunciation variability and linguistic constraints. Our Analysis spans over (i) number of DNN model parameters (for adaptation), (ii) amount of adaptation data, (iii) ages of children, (iv) age dependent-independent adaptation. Finally, we provide Recommendations on (i) the favorable strategies over various aforementioned - analyzed parameters, and (ii) potential future research directions and relevant challenges/problems persisting in DNN based ASR for children's speech.

Comprehensive literature review on children automatic speech recognition system, acoustic linguistic mismatch approaches and challenges

Automatic Speech Recognition (ASR) Systems for Children: A Systematic Literature Review

Usage of Prosody Modification and Acoustic Adaptation for Robust Automatic Speech Recognition (ASR) System

Automatic Screening for Children with Speech Disorder using Automatic Speech Recognition: Opportunities and Challenges

Transfer learning from adult to children for speech recognition: Evaluation, analysis and recommendations

End-to-End Neural Systems for Automatic Children Speech Recognition: An Empirical Study

Evaluation of state-of-the-art ASR Models in Child-Adult Interactions

A Comprehensive Study of the Current State-of-the-Art in Nepali Automatic Speech Recognition Systems

ChildAugment: Data Augmentation Methods for Zero-Resource Children's Speaker Verification

AI-Based Automated Speech Therapy Tools for persons with Speech Sound Disorders: A Systematic Literature Review

Automatic Speech Recognition of Non-Native Child Speech for Language Learning Applications

Automatic forced alignment on child speech: Directions for improvement

Automatic recognition of child speech for robotic applications in noisy environments

Bilingual Automatic Speech Recognition: A Review, Taxonomy and Open Challenges

Personalized Speech Recognition for Children with Test-Time Adaptation

Prosody Usage Optimization for Children Speech Recognition with Zero Resource Children Speech

In domain training data augmentation on noise robust Punjabi Children speech recognition

Error-preserving Automatic Speech Recognition of Young English Learners' Language

Role of Data Augmentation and Effective Conservation of High-Frequency Contents in the Context Children's Speaker Verification System

Kid-Whisper: Towards Bridging the Performance Gap in Automatic Speech Recognition for Children VS. Adults

Children Speech Disorder Detection Using Speech Analytics: A Literature Survey