Abstract:Sound event detection systems typically consist of two stages: extracting hand-crafted features from the raw audio waveform, and learning a mapping between these features and the target sound events using a classifier. Recently, the focus of sound event detection research has been mostly shifted to the latter stage using standard features such as mel spectrogram as the input for classifiers such as deep neural networks. In this work, we utilize end-to-end approach and propose to combine these two stages in a single deep neural network classifier. The feature extraction over the raw waveform is conducted by a feedforward layer block, whose parameters are initialized to extract the time-frequency representations. The feature extraction parameters are updated during training, resulting with a representation that is optimized for the specific task. This feature extraction block is followed by (and jointly trained with) a convolutional recurrent network, which has recently given state-of-the-art results in many sound recognition tasks. The proposed system does not outperform a convolutional recurrent network with fixed hand-crafted features. The final magnitude spectrum characteristics of the feature extraction block parameters indicate that the most relevant information for the given task is contained in 0 - 3 kHz frequency range, and this is also supported by the empirical results on the SED performance.

Teacher-Student Framework for Polyphonic Semi-supervised Sound Event Detection: Survey and Empirical Analysis

Polyphonic Sound Event and Sound Activity Detection: A Multi-Task Approach

Cross-Referencing Self-Training Network for Sound Event Detection in Audio Mixtures

Robust Audio Sensing with Multi-Sound Classification.

Active Learning for Sound Event Detection

A Comprehensive Review of Polyphonic Sound Event Detection

Anomalous sound event detection: A survey of machine learning based methods and applications

Training Sound Event Detection On A Heterogeneous Dataset

Polyphonic Sound Event Detection and Localization using a Two-Stage Strategy

Sound Event Detection in Multichannel Audio Using Spatial and Harmonic Features

A Multi-Task Learning Framework for Sound Event Detection using High-level Acoustic Characteristics of Sounds

Self-supervised object detection from audio-visual correspondence

Polyphonic training set synthesis improves self-supervised urban sound classification

Sound Event Detection for Human Safety and Security in Noisy Environments

RCT: Random Consistency Training for Semi-supervised Sound Event Detection

Sound Event Detection: A tutorial

A scene-dependent sound event detection approach using multi-task learning

End-to-End Polyphonic Sound Event Detection Using Convolutional Recurrent Neural Networks with Learned Time-Frequency Representation Input

A Multi-grained based Attention Network for Semi-supervised Sound Event Detection

Online Active Learning For Sound Event Detection