Abstract:The aim of overlapping sound event detection (SED) is to detect the sound events classes contained and the corresponding time stamps in audio. In real life, the sound events contained in a piece of audio are usually very complicated, and various sound events overlap and alternate, which greatly increases the difficulty of overlapping SED. In our past research, we found that the attention mechanism can effectively cope with the mentioned difficulty, as long as its need for reinforcement training on a large amount of strongly labeled data is satisfied. However, strongly labeled data is usually not easy to obtain, so how to use weakly labeled data has become mainstream. Against this background, we propose a new overlapping SED method that can effectively utilize weakly labeled data through the use of the feature-level attention pooling strategy under the multiple-instance learning (MIL) framework. Moreover, a feature-level attention pooling strategy with different learnable parameters is studied and compared with a decision-level attention pooling strategy in our work, so the advantages of attention with a feature-level attention pooling strategy in overlapping SED can be better shown. We compare the classification results of overlapping SED using feature-level and decision-level attention pooling in the DCASE 2021 task 4 scenario (Sound Event Detection and Separation in Domestic Environments). Test results show that the PSDS1 (focus on the sensitiveness to the detection speed) of feature-level attention pooling is kept unchanged (it means the learnable parameters training does not burden the overlapping SED), but the PSDS2 (focus on the classification effect) is improved by 3%, which is slightly above the score generated from the decision-level attention pooling (it means feature-level attention pooling has better returns). Although the results are only slightly improved when compared to the decision-level attention pooling, it has somehow improved research guidance for the research of improving the classification results of overlapping SED. Our conclusion is that feature-level attention pooling is good for exploiting weak-label data, and can achieve better classification without increasing computational complexity.

A Joint Detection-Classification Model for Weakly Supervised Sound Event Detection Using Multi-Scale Attention Method

Multi-Scale Time-Frequency Attention for Acoustic Event Detection

A Multi-grained based Attention Network for Semi-supervised Sound Event Detection

A scene-dependent sound event detection approach using multi-task learning

A Region Based Attention Method for Weakly Supervised Sound Event Detection and Classification

MULTI-SCALE CONVOLUTION BASED ATTENTION NETWORK FOR SEMI-SUPERVISED SOUND EVENT DETECTION Technical Report

Adaptive Memory-Controlled Self-Attention for Polyphonic Sound Event Detection

MTDA-HSED: Mutual-Assistance Tuning and Dual-Branch Aggregating for Heterogeneous Sound Event Detection

Sound Event Detection and Time-Frequency Segmentation from Weakly Labelled Data

Event Specific Attention for Polyphonic Sound Event Detection

Sound Event Detection and Time–Frequency Segmentation from Weakly Labelled Data

Polyphonic Sound Event Detection Using Temporal-Frequency Attention and Feature Space Attention

A Multi-Task Learning Framework for Sound Event Detection using High-level Acoustic Characteristics of Sounds

Feature-level Attention Pooling for Overlapping Sound Event Detection.

Improved Self-Consistency Training with Selective Feature Fusion for Sound Event Detection

Sound Event Detection Using Multi-Scale Dense Convolutional Recurrent Neural Network with Lightweight Attention

MSFF-Net: Multi-scale Feature Fusing Networks with Dilated Mixed Convolution and Cascaded Parallel Framework for Sound Event Detection.

Multitask frame-level learning for few-shot sound event detection

Task-Aware Mean Teacher Method for Large Scale Weakly Labeled Semi-Supervised Sound Event Detection

A Study of Improved Two-Stage Dual-Conv Coordinate Attention Model for Sound Event Detection and Localization

Attention mechanism combined with residual recurrent neural network for sound event detection and localization