Abstract:A key problem in spoken language identification (LID) is to design effective representations which are specific to language information. For example, in recent years, representations based on both phonotactic and acoustic features have proven their effectiveness for LID. Although advances in machine learning have led to significant improvements, LID performance is still lacking, especially for short duration speech utterances. With the hypothesis that language information is weak and represented only latently in speech, and is largely dependent on the statistical properties of the speech content, existing representations may be insufficient. Furthermore they may be susceptible to the variations caused by different speakers, specific content of the speech segments, and background noise. To address this, we propose using Deep Bottleneck Features (DBF) for spoken LID, motivated by the success of Deep Neural Networks (DNN) in speech recognition. We show that DBFs can form a low-dimensional compact representation of the original inputs with a powerful descriptive and discriminative capability. To evaluate the effectiveness of this, we design two acoustic models, termed DBF-TV and parallel DBF-TV (PDBF-TV), using a DBF based i-vector representation for each speech utterance. Results on NIST language recognition evaluation 2009 (LRE09) show significant improvements over state-of-the-art systems. By fusing the output of phonotactic and acoustic approaches, we achieve an EER of 1.08%, 1.89% and 7.01% for 30 s, 10 s and 3 s test utterances respectively. Furthermore, various DBF configurations have been extensively evaluated, and an optimal system proposed.

Deep Bottleneck Feature for Image Classification

Research on Image Classification Method of Features of Combinatorial Convolution

Shallow Binary Features Enhance the Robustness of Deep Convolutional Neural Networks

Deep Bottleneck Features For Spoken Language Identification

Deep Neural Network Derived Bottleneck Features For Accurate Audio Classification

Bag of Surrogate Parts Feature for Visual Recognition

The image annotation algorithm using convolutional features from intermediate layer of deep learning

DEFEATnet -- A Deep Conventional Image Representation for Image Classification

Local Deep Descriptors in Bag-of-Words for Image Retrieval.

Simple Techniques Make Sense: Feature Pooling and Normalization for Image Classification

Performance Evaluation of Deep Bottleneck Features for Spoken Language Identification

Learning Relative Features Through Adaptive Pooling for Image Classification

Learning Deep Bilinear Transformation for Fine-grained Image Representation

Object Level Deep Feature Pooling for Compact Image Representation

Combining bag of visual words-based features with CNN in image classification

Fast image classification algorithm based on deep convolutional neural network

Seeing the Big Picture: Deep Embedding with Contextual Evidences

IB-AdCSCNet:Adaptive Convolutional Sparse Coding Network Driven by Information Bottleneck

Convolutional Channel Features

Deep-seated features histogram: A novel image retrieval method

Learning Deep Classifiers With Deep Features