Abstract:Sound Event Detection (SED) needs to identify the sound events in a recording and detect the onset and offset times of them. The former desires features with long short-term dependencies to detect sound events with different durations and the latter needs fine-grained dependency. Although our previous proposed Multi-Scale Fully Convolutional Networks (MS-FCN) uses cascaded dilated convolution to model temporal context information and multi-scale information is considered, there are two shortages to deal with: the ignorance of neighboring information and fine-grained dependencies, and neglecting intermediate-length temporal dependencies. The first shortage is caused by the skipping elements sampling mechanism of dilated convolution, by which the neighboring information and fine-grained dependencies are ignored. To overcome this shortage, the paper proposes the dilated mixed convolution module, which mixes dilated convolution and standard convolutions to capture both the fine-grained and long-term dependencies and give weight to neighboring information. The second shortage is caused by the too fast increase of temporal dependent length in cascaded dilated convolution module, which causes too much intermediate temporal information to be ignored. For this shortage, this paper proposes Dilated Temporal Pyramid Pooling module (DTPP), in which parallel dilated convolutions with multiple dilation factors are used to capture the intermediate temporal information with a proper temporal dependent length. As cascaded module has been demonstrated to be valid and efficient to model the temporal context in MS-FCN and DTPP module can capture the ignored temporal information of cascaded module, taking the advantages of both, this paper proposes the cascaded parallel module to capture richer temporal dependencies. Based on that, Multi-Scale Feature Fusion Networks (MSFF-Net) is proposed, which obtains competitive performance on three open datasets.

Multi-frame Concatenation for Detection of Rare Sound Events Based on Deep Neural Network

Multi-Scale and Single-Scale Fully Convolutional Networks for Sound Event Detection

Multi-Scale Recurrent Neural Network for Sound Event Detection

Multitask frame-level learning for few-shot sound event detection

Sound event detection in real life audio using multi-model system

Sound Event Detection Using Multi-Scale Dense Convolutional Recurrent Neural Network with Lightweight Attention

Multi-Scale Convolutional Recurrent Neural Network with Ensemble Method for Weakly Labeled Sound Event Detection

Attention mechanism combined with residual recurrent neural network for sound event detection and localization

Sound Event Detection Via Conformer Recurrent Neural Networks

MSFF-Net: Multi-scale Feature Fusing Networks with Dilated Mixed Convolution and Cascaded Parallel Framework for Sound Event Detection.

Dilated-Gated Convolutional Neural Network with A New Loss Function on Sound Event Detection.

Polyphonic Sound Event Detection Based on CapsNet-RNN and Post Processing Optimization

An improved weakly supervised learning system for detection of sound events in domestic environments

Conditioned Time-Dilated Convolutions for Sound Event Detection

Rare Sound Event Detection Using Deep Learning and Data Augmentation

A scene-dependent sound event detection approach using multi-task learning

DEW: A wavelet approach of rare sound event detection

MTF-CRNN: Multiscale Time-Frequency Convolutional Recurrent Neural Network for Sound Event Detection.

Weakly supervised CRNN system for sound event detection with large-scale unlabeled in-domain data

Adaptive Memory-Controlled Self-Attention for Polyphonic Sound Event Detection

A Multi-Task Learning Framework for Sound Event Detection using High-level Acoustic Characteristics of Sounds