Abstract:There are a number of studies about extraction of bottleneck (BN) features from deep neural networks (DNNs) trained to discriminate speakers, pass-phrases, and triphone states for improving the performance of text-dependent speaker verification (TD-SV). However, a moderate success has been achieved. A recent study presented a time contrastive learning (TCL) concept to explore the non-stationarity of brain signals for classification of brain states. Speech signals have similar non-stationarity property, and TCL further has the advantage of having no need for labeled data. We therefore present a TCL based BN feature extraction method. The method uniformly partitions each speech utterance in a training dataset into a predefined number of multi-frame segments. Each segment in an utterance corresponds to one class, and class labels are shared across utterances. DNNs are then trained to discriminate all speech frames among the classes to exploit the temporal structure of speech. In addition, we propose a segment-based unsupervised clustering algorithm to re-assign class labels to the segments. TD-SV experiments were conducted on the RedDots challenge database. The TCL-DNNs were trained using speech data of fixed pass-phrases that were excluded from the TD-SV evaluation set, so the learned features can be considered phrase-independent. We compare the performance of the proposed TCL BN feature with those of short-time cepstral features and BN features extracted from DNNs discriminating speakers, pass-phrases, speaker+pass-phrase, as well as monophones whose labels and boundaries are generated by three different automatic speech recognition (ASR) systems. Experimental results show that the proposed TCL-BN outperforms cepstral features and speaker+pass-phrase discriminant BN features, and its performance is on par with those of ASR derived BN features. Moreover, the clustering method improves the TD-SV performance of TCL-BN and ASR derived BN features with respect to their standalone counterparts. We further study the TD-SV performance of fusing cepstral and BN features.

Improvements on bottleneck feature for large vocabulary continuous speech recognition

Improving Bottleneck Features for Automatic Speech Recognition Using Gammatone-Based Cochleagram and Sparsity Regularization

Bottleneck Features Based On Gammatone Frequency Cepstral Coefficients

Improved Bottleneck Feature Using Hierarchical Deep Belief Networks for Keyword Spotting in Continues Speech

Subspace Models For Bottleneck Features

Improving deep neural networks for LVCSR using dropout and shrinking structure

Improving Blstm Rnn Based Mandarin Speech Recognition Using Accent Dependent Bottleneck Features

Speech Bandwidth Extension Using Bottleneck Features and Deep Recurrent Neural Networks.

Time-Contrastive Learning Based Deep Bottleneck Features for Text-Dependent Speaker Verification

Bayesian Learning of LF-MMI Trained Time Delay Neural Networks for Speech Recognition

Investigation of deep neural networks (DNN) for large vocabulary continuous speech recognition: Why DNN surpasses GMMS in acoustic modeling

Investigation Of Bottleneck Features And Multilingual Deep Neural Networks For Speaker Verification

Deep LSTM for Large Vocabulary Continuous Speech Recognition

Improvement Comparison of Different Lattice-based Discriminative Training Methods in Chinese-monolingual and Chinese-English-bilingual Speech Recognition

A Cluster-Based Multiple Deep Neural Networks Method for Large Vocabulary Continuous Speech Recognition

Continuous Speech Recognition Based on the Triphone DDBHMM

Multilingual Bottleneck Features for Query by Example Spoken Term Detection

Highway Long Short-Term Memory RNNs for Distant Speech Recognition

Integrating Lattice-Free MMI into End-to-End Speech Recognition

Deep Neural Network-Based Bottleneck Feature and Denoising Autoencoder-Based Dereverberation for Distant-Talking Speaker Identification.

Speaker Recognition System Based on Deep Neural Networks and Bottleneck Features