Abstract:In recent years, text-independent speaker verification has remained a hot research topic, especially for the limited enrollment and/or test data. At the same time, due to the lack of sufficient training data, the study of low-resource few-shot speaker verification makes the models prone to overfitting and low accuracy of recognition. Therefore, a bidirectional sampling aggregation-based meta-metric learning method is proposed to solve the low-accuracy problem of speaker recognition in a low-resource environment with limited data, termed bidirectional sampling multi-scale Fisher feature fusion (BSML). First, the BSML method was used for effective feature enhancement in the feature extraction stage; second, a large number of similar and disjoint tasks were used to train the models to learn how to compare sample similarity; finally, new tasks were used to identify unknown samples by calculating the similarity of the samples. Extensive experiments are conducted on a short-duration text-independent speaker verification dataset generated from the THUYG-20 low-resource Uyghur with limited data, which comprised speech samples of diverse lengths. The experimental result has shown that the metric learning approach is effective in avoiding model overfitting and improving model generalization, with significant results in the identification of short-duration speaker verification in low-resource Uyghur with few-shot. It also demonstrates that BSML outperforms the state-of-the-art deep-embedding speaker recognition architectures and recent metric learning approach by at least 18%–67% in the few-shot test set. The ablation experiments further illustrate that our proposed approaches can achieve substantial improvement over prior methods and achieves better performance and generalization ability.

BSML: Bidirectional Sampling Aggregation-based Metric Learning for Low-resource Uyghur Few-shot Speaker Verification

Preliminary Study on Self-contained UBM Construction for Speaker Recognition.

Few-shot short utterance speaker verification using meta-learning

Multi-task Metric Learning for Text-independent Speaker Verification

Fisher ratio-based multi-domain frame-level feature aggregation for short utterance speaker verification

Bidirectional Multiscale Feature Aggregation for Speaker Verification

Deep Multi-Metric Learning for Text-Independent Speaker Verification

Short Utterance Speaker Recognition Based on Speech High Frequency Information Compensation and Dynamic Feature Enhancement Methods

Meta-Generating Deep Attentive Metric for Few-Shot Classification

Getting More for Less: Using Weak Labels and AV-Mixup for Robust Audio-Visual Speaker Verification

Multi-Fisher and Triple-Domain Feature Enhancement-Based Short Utterance Speaker Verification for IoT Smart Service

Improving Short Utterance Speaker Recognition by Modeling Speech Unit Classes

ML-FDA: Meta-Learning via Feature Distribution Alignment for Few-Shot Learning

Meta-Generalization for Domain-Invariant Speaker Verification.

Adversarial Meta Sampling for Multilingual Low-Resource Speech Recognition

Few-Shot Speaker Identification Using Lightweight Prototypical Network With Feature Grouping and Interaction

A Fishervoice Based Feature Fusion Method for Short Utterance Speaker Recognition

Bridging Mixture Density Networks with Meta-Learning for Automatic Speaker Identification

Speaker Verification by Partial AUC Optimization with Mahalanobis Distance Metric Learning

FMCF: Few-shot Multimodal Aspect-Based Sentiment Analysis Framework Based on Contrastive Finetuning