Abstract:In this paper, we investigate high-resolution modeling units of deep neural networks (DNNs) from concrete to abstract for acoustic scene classification based on Gaussian mixture model (GMM) and ergodic hidden Markov model (HMM). A direct modeling strategy for DNN to classify acoustic scenes is to map each frame feature of an audio to one scene category. However, all frames tagged with the same label may not be the best choice because the representative pattern of an audio is sparse. GMM is also often employed to model each acoustic scene directly as a generative model. Because the multiple Gaussians in a GMM model have different levels of contribution, and each Gaussian can be seen as a subclass of the scene category, so we can utilize the subclass of GMM as a bit abstract modeling unit to adopt DNN-GMM system. When single scene category is subdivided into various subclasses, prior scores for each subclass calculated from training set are stored as one part of model to response the sparseness of representative pattern. Ergodic HMM should be more appropriate to model the acoustic scenes than GMM due to the uncertain structure of scene audio. Using HMM states as modeling units, we build DNN-HMM hybrid system. By comparison, we find high-resolution modeling units are more effective than direct modeling. The final system is obtained by performing system combination to take advantage of the complementarity of different-level modeling units. Experiments on acoustic scene classification task of DCASE2016 challenge show that our final system yields 25.9% relative error rate reduction compared with a GMM baseline on evaluation set.

An Investigation on Multiscale Normalised Deep Scattering Spectrum with Deep Residual Network for Acoustic Scene Classification

Multi-level Attention Model with Deep Scattering Spectrum for Acoustic Scene Classification.

Deep semantic learning for acoustic scene classification

Deep Sequential Image Features on Acoustic Scene Classification.

Deep Scalogram Representations for Acoustic Scene Classification

Acoustic Scene Classification Using Deep Convolutional Neural Network and Multiple Spectrograms Fusion.

Acoustic Scene Classification Using Deep CNNs with Time-Frequency Representations

Acoustic Scene Classification Using Aggregation of Two-Scale Deep Embeddings.

A Low-Compexity Deep Learning Framework For Acoustic Scene Classification

Deep Segment Model for Acoustic Scene Classification

ACOUSTIC SCENE CLASSIFICATION USING ENSEMBLES OF DEEP RESIDUAL NETWORKS AND SPECTROGRAM DECOMPOSITIONS Technical Report

Acoustic scene classification based on three-dimensional multi-channel feature-correlated deep learning networks

Deep Neural Decision Forest for Acoustic Scene Classification

Long-term scalogram integrated with an iterative data augmentation scheme for acoustic scene classification

A Comparison of deep learning methods for environmental sound

An Investigation of Transfer Learning Mechanism for Acoustic Scene Classification

An Investigation of High-Resolution Modeling Units of Deep Neural Networks for Acoustic Scene Classification

A Hybrid Approach to Acoustic Scene Classification Based on Universal Acoustic Models.

Bi-level Acoustic Scene Classification Using Lightweight Deep Learning Model

Multi-Temporal Resolution Convolutional Neural Networks for Acoustic Scene Classification

Hierarchical learning for DNN-based acoustic scene classification