Abstract:Adapting speaker recognition systems to new environments is a widely-used technique to improve a well-performing model learned from large-scale data towards a task-specific small-scale data scenarios. However, previous studies focus on single domain adaptation, which neglects a more practical scenario where training data are collected from multiple acoustic domains needed in forensic scenarios. Audio analysis for forensic speaker recognition offers unique challenges in model training with multi-domain training data due to location/scenario uncertainty and diversity mismatch between reference and naturalistic field recordings. It is also difficult to directly employ small-scale domain-specific data to train complex neural network architectures due to domain mismatch and performance loss. Fine-tuning is a commonly-used method for adaptation in order to retrain the model with weights initialized from a well-trained model. Alternatively, in this study, three novel adaptation methods based on domain adversarial training, discrepancy minimization, and moment-matching approaches are proposed to further promote adaptation performance across multiple acoustic domains. A comprehensive set of experiments are conducted to demonstrate that: 1) diverse acoustic environments do impact speaker recognition performance, which could advance research in audio forensics, 2) domain adversarial training learns the discriminative features which are also invariant to shifts between domains, 3) discrepancy-minimizing adaptation achieves effective performance simultaneously across multiple acoustic domains, and 4) moment-matching adaptation along with dynamic distribution alignment also significantly promotes speaker recognition performance on each domain, especially for the LENA-field domain with noise compared to all other systems.

Damage Control During Domain Adaptation for Transducer Based Automatic Speech Recognition

A Study of Enhancement, Augmentation, and Autoencoder Methods for Domain Adaptation in Distant Speech Recognition

Multi-source Domain Adaptation for Text-independent Forensic Speaker Recognition

Unsupervised Domain Adaptation for Robust Speech Recognition via Variational Autoencoder-Based Data Augmentation

Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition

Learning not to Discriminate: Task Agnostic Learning for Improving Monolingual and Code-switched Speech Recognition

Mitigating the Impact of Speech Recognition Errors on Spoken Question Answering by Adversarial Domain Adaptation

Improving Distortion Robustness of Self-supervised Speech Processing Tasks with Domain Adaptation

Domain Adaptation Using Suitable Pseudo Labels for Speech Enhancement and Dereverberation

Domain Adaptation with Augmented Data by Deep Neural Network Based Method Using Re-Recorded Speech for Automatic Speech Recognition in Real Environment

Unsupervised Domain Adaptation for Dysarthric Speech Detection via Domain Adversarial Training and Mutual Information Minimization

Exploring Machine Speech Chain for Domain Adaptation and Few-Shot Speaker Adaptation

Don't Stop Self-Supervision: Accent Adaptation of Speech Representations via Residual Adapters

Sequential Editing for Lifelong Training of Speech Recognition Models

Toward Domain-Invariant Speech Recognition via Large Scale Training

Towards Better Domain Adaptation for Self-supervised Models: A Case Study of Child ASR

Modular Domain Adaptation for Conformer-Based Streaming ASR

Domain Adaptation for Contrastive Audio-Language Models

Domain and Speaker Adaptation for Cortana Speech Recognition

Multi-Domain Adaptation by Self-Supervised Learning for Speaker Verification

Enhancing Dysarthric Speech Recognition for Unseen Speakers via Prototype-Based Adaptation