Abstract:Deep neural networks (DNNs) have been proven to be powerful models for acoustic scene classification tasks. State-of-the-art DNNs have millions of connections and are computationally intensive, making them difficult to deploy on systems with limited resources. With a focus on acoustic scene classification, we describe a new learnable module, the simulated Fourier transform module, which allows deep neural networks to implement the discrete Fourier transform operation 8x faster on a graphics processing unit (GPU). We frame the signal processing procedure as an adaptive machine learning problem and introduce learnable parameters in the module to facilitate fast adaptation for the complex and variable acoustic signal. This module gives neural networks the ability to model audio signals from raw waveforms, without extra fast Fourier transform and filter bank patches. Then, we use the temporal transformer module, which has been previously published, to alleviate the information loss caused by the simulated Fourier transform module. These techniques can be integrated into an existing fully connected neural network (FCNN), convolutional neural network (CNN), or recurrent neural network (RNN) models. We evaluate the proposed strategy using four acoustic scene datasets (LITIS Rouen, DCASE2016, DCASE2017, and DCASE2018) as target tasks. We show that the proposed approach significantly outperforms the vanilla FCNN, CNN, and RNN approach on both efficiency and performance. For instance, the proposed approach can reduce inference time by 8x while reducing the classification error on LITIS Rouen dataset from 3.21% to 1.81%.

Temporal Transformer Networks for Acoustic Scene Classification

Constrained Learned Feature Extraction for Acoustic Scene Classification

Multi-Temporal Resolution Convolutional Neural Networks for Acoustic Scene Classification

Spatio-Temporal Attention Pooling for Audio Scene Classification

Acoustic scene classification using multi-layer temporal pooling based on convolutional neural network.

Learning Temporal Relations from Semantic Neighbors for Acoustic Scene Classification

Temporal Transformer Networks with Self-Supervision for Action Recognition.

Deep Temporal Convolution Network for Time Series Classification

ATReSN-Net: Capturing Attentive Temporal Relations in Semantic Neighborhood for Acoustic Scene Classification.

Audio Transformers:Transformer Architectures For Large Scale Audio Understanding. Adieu Convolutions

Multi-Modal Attention Mechanisms In Lstm And Its Application To Acoustic Scene Classification

Data Independent Sequence Augmentation Method For Acoustic Scene Classification

A Low-Compexity Deep Learning Framework For Acoustic Scene Classification

Acoustic Scene Recognition Based on Convolutional Neural Networks

Multi-stream Network With Temporal Attention For Environmental Sound Classification

TSLANet: Rethinking Transformers for Time Series Representation Learning

A convolutional neural network approach for acoustic scene classification

Audio Time-Scale Modification with Temporal Compressing Networks

CT-SAT: Contextual Transformer for Sequential Audio Tagging

TempoFormer: A Transformer for Temporally-aware Representations in Change Detection

Ensemble Of Deep Neural Networks For Acoustic Scene Classification