Abstract:There are a number of studies about extraction of bottleneck (BN) features from deep neural networks (DNNs) trained to discriminate speakers, pass-phrases, and triphone states for improving the performance of text-dependent speaker verification (TD-SV). However, a moderate success has been achieved. A recent study presented a time contrastive learning (TCL) concept to explore the non-stationarity of brain signals for classification of brain states. Speech signals have similar non-stationarity property, and TCL further has the advantage of having no need for labeled data. We therefore present a TCL based BN feature extraction method. The method uniformly partitions each speech utterance in a training dataset into a predefined number of multi-frame segments. Each segment in an utterance corresponds to one class, and class labels are shared across utterances. DNNs are then trained to discriminate all speech frames among the classes to exploit the temporal structure of speech. In addition, we propose a segment-based unsupervised clustering algorithm to re-assign class labels to the segments. TD-SV experiments were conducted on the RedDots challenge database. The TCL-DNNs were trained using speech data of fixed pass-phrases that were excluded from the TD-SV evaluation set, so the learned features can be considered phrase-independent. We compare the performance of the proposed TCL BN feature with those of short-time cepstral features and BN features extracted from DNNs discriminating speakers, pass-phrases, speaker+pass-phrase, as well as monophones whose labels and boundaries are generated by three different automatic speech recognition (ASR) systems. Experimental results show that the proposed TCL-BN outperforms cepstral features and speaker+pass-phrase discriminant BN features, and its performance is on par with those of ASR derived BN features. Moreover, the clustering method improves the TD-SV performance of TCL-BN and ASR derived BN features with respect to their standalone counterparts. We further study the TD-SV performance of fusing cepstral and BN features.

Phonetic Feature Extraction by Time-Sequence Binary Classifiers.

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

Time-Frequency Cepstral Features and Combining Discriminative Training for Phonotactic Language Recognition

Time-frequency Network for Robust Speaker Recognition

Investigation of Tandem Deep Belief Network Approach for Phoneme Recognition

Time-Contrastive Learning Based Deep Bottleneck Features for Text-Dependent Speaker Verification

Time–Frequency Cepstral Features and Heteroscedastic Linear Discriminant Analysis for Language Recognition

Auditory Feature for Monaural Speech Segregation

Bipolar Population Threshold Encoding for Audio Recognition with Deep Spiking Neural Networks

Segment-Based Features for Time Series Classification

Temporal Coding of Local Spectrogram Features for Robust Sound Recognition

Target Speaker Extraction Using Attention-Enhanced Temporal Convolutional Network

TST: Time-Sparse Transducer for Automatic Speech Recognition

Variant Time-Frequency Cepstral Features for Speaker Recognition

Hybrid CTC-Attention Based End-to-End Speech Recognition Using Subword Units

TFCnet: Time-Frequency Domain Corrector for Speech Separation

Phonetic Temporal Neural Model for Language Identification

A Time Series Forest for Classification and Feature Extraction

Fast learning algorithms for time-delay neural networks phoneme recognition

A Fast Learning Algorithm for Time-Delay Neural Networks