Abstract:Adapting speaker recognition systems to new environments is a widely-used technique to improve a well-performing model learned from large-scale data towards a task-specific small-scale data scenarios. However, previous studies focus on single domain adaptation, which neglects a more practical scenario where training data are collected from multiple acoustic domains needed in forensic scenarios. Audio analysis for forensic speaker recognition offers unique challenges in model training with multi-domain training data due to location/scenario uncertainty and diversity mismatch between reference and naturalistic field recordings. It is also difficult to directly employ small-scale domain-specific data to train complex neural network architectures due to domain mismatch and performance loss. Fine-tuning is a commonly-used method for adaptation in order to retrain the model with weights initialized from a well-trained model. Alternatively, in this study, three novel adaptation methods based on domain adversarial training, discrepancy minimization, and moment-matching approaches are proposed to further promote adaptation performance across multiple acoustic domains. A comprehensive set of experiments are conducted to demonstrate that: 1) diverse acoustic environments do impact speaker recognition performance, which could advance research in audio forensics, 2) domain adversarial training learns the discriminative features which are also invariant to shifts between domains, 3) discrepancy-minimizing adaptation achieves effective performance simultaneously across multiple acoustic domains, and 4) moment-matching adaptation along with dynamic distribution alignment also significantly promotes speaker recognition performance on each domain, especially for the LENA-field domain with noise compared to all other systems.

Disentangled Adversarial Domain Adaptation for Phonation Mode Detection in Singing and Speech

Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition

Unsupervised Domain Adaptation for Dysarthric Speech Detection via Domain Adversarial Training and Mutual Information Minimization

Unsupervised Domain Adaptation for Robust Speech Recognition via Variational Autoencoder-Based Data Augmentation

Domain Adaptation For Formant Estimation Using Deep Learning

Noise Adaptive Speech Enhancement Using Domain Adversarial Training.

DEAAN: Disentangled Embedding and Adversarial Adaptation Network for Robust Speaker Representation Learning

Domain Adaptation Using Suitable Pseudo Labels for Speech Enhancement and Dereverberation

Multi-source Domain Adaptation for Text-independent Forensic Speaker Recognition

Unsupervised Representation Disentanglement using Cross Domain Features and Adversarial Learning in Variational Autoencoder based Voice Conversion

Multi-Domain Adaptation by Self-Supervised Learning for Speaker Verification

Deep Audio-Visual Singing Voice Transcription based on Self-Supervised Learning Models

Residual Attention Based Network for Automatic Classification of Phonation Modes

Adversarial Learning of Raw Speech Features for Domain Invariant Speech Recognition

Learning Invariant Representation and Risk Minimized for Unsupervised Accent Domain Adaptation

Text-Only Domain Adaptation for End-to-End Speech Recognition through Down-Sampling Acoustic Representation

Adversarial Teacher-Student Learning for Unsupervised Domain Adaptation

A Study of Enhancement, Augmentation, and Autoencoder Methods for Domain Adaptation in Distant Speech Recognition

Adversarial Multi-Task Learning for Disentangling Timbre and Pitch in Singing Voice Synthesis

Towards Better Domain Adaptation for Self-supervised Models: A Case Study of Child ASR

Stethoscope-guided Supervised Contrastive Learning for Cross-domain Adaptation on Respiratory Sound Classification