Abstract:In this paper, we investigate high-resolution modeling units of deep neural networks (DNNs) from concrete to abstract for acoustic scene classification based on Gaussian mixture model (GMM) and ergodic hidden Markov model (HMM). A direct modeling strategy for DNN to classify acoustic scenes is to map each frame feature of an audio to one scene category. However, all frames tagged with the same label may not be the best choice because the representative pattern of an audio is sparse. GMM is also often employed to model each acoustic scene directly as a generative model. Because the multiple Gaussians in a GMM model have different levels of contribution, and each Gaussian can be seen as a subclass of the scene category, so we can utilize the subclass of GMM as a bit abstract modeling unit to adopt DNN-GMM system. When single scene category is subdivided into various subclasses, prior scores for each subclass calculated from training set are stored as one part of model to response the sparseness of representative pattern. Ergodic HMM should be more appropriate to model the acoustic scenes than GMM due to the uncertain structure of scene audio. Using HMM states as modeling units, we build DNN-HMM hybrid system. By comparison, we find high-resolution modeling units are more effective than direct modeling. The final system is obtained by performing system combination to take advantage of the complementarity of different-level modeling units. Experiments on acoustic scene classification task of DCASE2016 challenge show that our final system yields 25.9% relative error rate reduction compared with a GMM baseline on evaluation set.

Synthesized Stereo Mapping Via Deep Neural Networks for Noisy Speech Recognition

Synthesized Stereo-Based Stochastic Mapping with Data Selection for Robust Speech Recognition.

DNN-based Stochastic Postfilter for HMM-based Speech Synthesis

Stereo Hidden Markov Modeling for Noise Robust Speech Recognition

Joint Training Of Front-End And Back-End Deep Neural Networks For Robust Speech Recognition

A regression approach to speech enhancement based on deep neural networks

Acoustic to Articulatory Mapping with Deep Neural Network

A Unified Speaker-Dependent Speech Separation and Enhancement System Based on Deep Neural Networks.

Spectral Conversion Using Deep Neural Networks Trained with Multi-Source Speakers

An Experimental Study on Joint Modeling of Mixed-Bandwidth Data Via Deep Neural Networks for Robust Speech Recognition.

Deep Neural Network Based Voice Conversion with A Large Synthesized Parallel Corpus

Robust Speech Recognition With Speech Enhanced Deep Neural Networks

Joint Training of DNNs by Incorporating an Explicit Dereverberation Structure for Distant Speech Recognition

An Improved VTS Feature Compensation Using Mixture Models of Distortion and IVN Training for Noisy Speech Recognition

Improving Deep Neural Networks Based Speaker Verification Using Unlabeled Data

Stereo-based Stochastic Mapping with Context Using Probabilistic PCA for Noise Robust Automatic Speech Recognition

Phonotactic language recognition based on DNN-HMM acoustic model

Very Deep Convolutional Neural Networks for Robust Speech Recognition

Voice Conversion Using Deep Neural Networks with Layer-Wise Generative Training

An Investigation of High-Resolution Modeling Units of Deep Neural Networks for Acoustic Scene Classification

Speech Separation Based on Signal-Noise-dependent Deep Neural Networks for Robust Speech Recognition