Abstract:In this paper, we investigate high-resolution modeling units of deep neural networks (DNNs) from concrete to abstract for acoustic scene classification based on Gaussian mixture model (GMM) and ergodic hidden Markov model (HMM). A direct modeling strategy for DNN to classify acoustic scenes is to map each frame feature of an audio to one scene category. However, all frames tagged with the same label may not be the best choice because the representative pattern of an audio is sparse. GMM is also often employed to model each acoustic scene directly as a generative model. Because the multiple Gaussians in a GMM model have different levels of contribution, and each Gaussian can be seen as a subclass of the scene category, so we can utilize the subclass of GMM as a bit abstract modeling unit to adopt DNN-GMM system. When single scene category is subdivided into various subclasses, prior scores for each subclass calculated from training set are stored as one part of model to response the sparseness of representative pattern. Ergodic HMM should be more appropriate to model the acoustic scenes than GMM due to the uncertain structure of scene audio. Using HMM states as modeling units, we build DNN-HMM hybrid system. By comparison, we find high-resolution modeling units are more effective than direct modeling. The final system is obtained by performing system combination to take advantage of the complementarity of different-level modeling units. Experiments on acoustic scene classification task of DCASE2016 challenge show that our final system yields 25.9% relative error rate reduction compared with a GMM baseline on evaluation set.

Hierarchical learning for DNN-based acoustic scene classification

Hierarchical classification for acoustic scenes using deep learning

An Investigation of High-Resolution Modeling Units of Deep Neural Networks for Acoustic Scene Classification

Ensemble Of Deep Neural Networks For Acoustic Scene Classification

Deep Neural Decision Forest for Acoustic Scene Classification

Acoustic scene classification based on three-dimensional multi-channel feature-correlated deep learning networks

Environmental Sound Classification Based on Multi-temporal Resolution Convolutional Neural Network Combining with Multi-level Features

Deep semantic learning for acoustic scene classification

An Investigation on Multiscale Normalised Deep Scattering Spectrum with Deep Residual Network for Acoustic Scene Classification

A Comparison of deep learning methods for environmental sound

Deep Segment Model for Acoustic Scene Classification

A Hybrid Approach to Acoustic Scene Classification Based on Universal Acoustic Models.

Multi-Temporal Resolution Convolutional Neural Networks for Acoustic Scene Classification

An Investigation of Transfer Learning Mechanism for Acoustic Scene Classification

Low-complexity deep learning frameworks for acoustic scene classification using teacher-student scheme and multiple spectrograms

DD-CNN: Depthwise Disout Convolutional Neural Network for Low-complexity Acoustic Scene Classification

A Low-Compexity Deep Learning Framework For Acoustic Scene Classification

High-Resolution Attention Network with Acoustic Segment Model for Acoustic Scene Classification

Hierarchical-Concatenate Fusion TDNN for sound event classification

Deep Neural Network Based Environment Sound Classification and Its Implementation on Hearing Aid App

Low-Complexity Acoustic Scene Classification Using Parallel Attention-Convolution Network