Abstract:Sound event detection (SED) is the task of tagging the absence or presence of audio events and their corresponding interval within a given audio clip. While SED can be done using supervised machine learning, where training data is fully labeled with access to per event timestamps and duration, our work focuses on weakly-supervised sound event detection (WSSED), where prior knowledge about an event's duration is unavailable. Recent research within the field focuses on improving segment- and event-level localization performance for specific datasets regarding specific evaluation metrics. Specifically, well-performing event-level localization requires fully labeled development subsets to obtain event duration estimates, which significantly benefits localization performance. Moreover, well-performing segment-level localization models output predictions at a coarse-scale (e.g., 1 second), hindering their deployment on datasets containing very short events (< 1 second). This work proposes a duration robust CRNN (CDur) framework, which aims to achieve competitive performance in terms of segment- and event-level localization. This paper proposes a new post-processing strategy named "Triple Threshold" and investigates two data augmentation methods along with a label smoothing method within the scope of WSSED. Evaluation of our model is done on the DCASE2017 and 2018 Task 4 datasets, and URBAN-SED. Our model outperforms other approaches on the DCASE2018 and URBAN-SED datasets without requiring prior duration knowledge. In particular, our model is capable of similar performance to strongly-labeled supervised models on the URBAN-SED dataset. Lastly, ablation experiments to reveal that without post-processing, our model's localization performance drop is significantly lower compared with other approaches.

Sound Event Detection by Consistency Training and Pseudo-Labeling with Feature-Pyramid Convolutional Recurrent Neural Networks

Weakly supervised CRNN system for sound event detection with large-scale unlabeled in-domain data

Multi-Scale Recurrent Neural Network for Sound Event Detection

Weakly and semi-supervised learning for sound event detection using image pretrained convolutional recurrent neural network, weighted pooling and mean teacher method

Sound Event Detection and Time-Frequency Segmentation from Weakly Labelled Data

Adaptive Memory-Controlled Self-Attention for Polyphonic Sound Event Detection

Sound event detection via dilated convolutional recurrent neural networks

Semi-supervsied Learning-based Sound Event Detection using Freuqency Dynamic Convolution with Large Kernel Attention for DCASE Challenge 2023 Task 4

Sound Event Detection and Time–Frequency Segmentation from Weakly Labelled Data

Polyphonic Sound Event Detection and Localization using a Two-Stage Strategy

A Capsule based Approach for Polyphonic Sound Event Detection

Multi-Scale Convolutional Recurrent Neural Network with Ensemble Method for Weakly Labeled Sound Event Detection

Guided Learning Convolution System for DCASE 2019 Task 4

Auditory Neural Response Inspired Sound Event Detection Based on Spectro-temporal Receptive Field

Towards duration robust weakly supervised sound event detection

Sound Event Detection of Weakly Labelled Data With CNN-Transformer and Automatic Threshold Optimization

MULTI-SCALE CONVOLUTION BASED ATTENTION NETWORK FOR SEMI-SUPERVISED SOUND EVENT DETECTION Technical Report

AST-SED: An Effective Sound Event Detection Method Based on Audio Spectrogram Transformer

MAT-SED: A Masked Audio Transformer with Masked-Reconstruction Based Pre-training for Sound Event Detection

FMSG-JLESS Submission for DCASE 2024 Task4 on Sound Event Detection with Heterogeneous Training Dataset and Potentially Missing Labels

A scene-dependent sound event detection approach using multi-task learning