Abstract:Current methods based on the traditional i-vectors and deep neural network (DNN) have shown effectiveness on the speaker identification task, especially with the corpus of large scale. However, when the size of the training dataset is small, the overfitting problem may happen and lead to performance degradation. Besides, the robust identification still remains a challenging problem even under the less strict requirements. This paper proposes a novel approach, SpeakerGAN, for speaker identification with the conditional generative adversarial network (CGAN). It allows the adversarial networks for distinguishing real/fake samples and predicting class labels simultaneously. We configure the generator and the discriminator in SpeakerGAN with the gated convolutional neural network (CNN) and the modified residual network (ResNet) to obtain generated samples of high diversity as well as increase the network capacity. The multiple loss functions are combined and optimized to encourage the correct mapping and accelerate the convergence. Experimental results show that SpeakerGAN reduces the classification error rate by 87% and 16% compared with the traditional i-vector system and the state-of-the-art DNN based method. Under the scenario of limited training data, SpeakerGAN obtains significant improvement over the baselines. In the case of taking 1.6 s of each speaker for testing, SpeakerGAN achieves the identification accuracy of 98.20%, which suggests the promise for short-utterance speaker identification. (C) 2020 Elsevier B.V. All rights reserved.

Few-Shot Speaker Identification Using Depthwise Separable Convolutional Network with Channel Attention

Few-Shot Speaker Identification Using Lightweight Prototypical Network With Feature Grouping and Interaction

Self-attention Based Speaker Recognition Using Cluster-Range Loss

Few Shot Speaker Recognition using Deep Neural Networks

Focal Kl-Divergence Based Dilated Convolutional Neural Networks for Co-Channel Speaker Identification.

CACRN-Net: A 3D log Mel spectrogram based channel attention convolutional recurrent neural network for few-shot speaker identification

Self-Attention Networks for Text-Independent Speaker Verification

Few-shot short utterance speaker verification using meta-learning

Weighted Cluster-Range Loss and Criticality-Enhancement Loss for Speaker Recognition

Improving Noise Robustness In Speaker Identification Using A Two-Stage Attention Model

Few-shot Underwater Acoustic Target Recognition Based on Siamese Network

Few-Shot Audio Classification with Attentional Graph Neural Networks

Look, Listen and Learn - A Multimodal LSTM for Speaker Identification

SpeakerGAN: Speaker identification with conditional generative adversarial network

RACP: A Network with Attention Corrected Prototype for Few-shot Speaker Recognition Using Indefinite Distance Metric

Speakerfilter: deep learning-based target speaker extraction using anchor speech

Automatic Speaker Recognition with Limited Data.

3D Convolutional Neural Networks Based Speaker Identification and Authentication.

Fully Few-shot Class-incremental Audio Classification Using Expandable Dual-embedding Extractor

Speaker Verification System Based on Deformable CNN and Time-Frequency Attention.