Abstract:Sound Event Detection (SED) needs to identify the sound events in a recording and detect the onset and offset times of them. The former desires features with long short-term dependencies to detect sound events with different durations and the latter needs fine-grained dependency. Although our previous proposed Multi-Scale Fully Convolutional Networks (MS-FCN) uses cascaded dilated convolution to model temporal context information and multi-scale information is considered, there are two shortages to deal with: the ignorance of neighboring information and fine-grained dependencies, and neglecting intermediate-length temporal dependencies. The first shortage is caused by the skipping elements sampling mechanism of dilated convolution, by which the neighboring information and fine-grained dependencies are ignored. To overcome this shortage, the paper proposes the dilated mixed convolution module, which mixes dilated convolution and standard convolutions to capture both the fine-grained and long-term dependencies and give weight to neighboring information. The second shortage is caused by the too fast increase of temporal dependent length in cascaded dilated convolution module, which causes too much intermediate temporal information to be ignored. For this shortage, this paper proposes Dilated Temporal Pyramid Pooling module (DTPP), in which parallel dilated convolutions with multiple dilation factors are used to capture the intermediate temporal information with a proper temporal dependent length. As cascaded module has been demonstrated to be valid and efficient to model the temporal context in MS-FCN and DTPP module can capture the ignored temporal information of cascaded module, taking the advantages of both, this paper proposes the cascaded parallel module to capture richer temporal dependencies. Based on that, Multi-Scale Feature Fusion Networks (MSFF-Net) is proposed, which obtains competitive performance on three open datasets.

MULTI-SCALE CONVOLUTION BASED ATTENTION NETWORK FOR SEMI-SUPERVISED SOUND EVENT DETECTION Technical Report

Attention mechanism combined with residual recurrent neural network for sound event detection and localization

Multi-Scale and Single-Scale Fully Convolutional Networks for Sound Event Detection

A Multi-grained based Attention Network for Semi-supervised Sound Event Detection

Multi-Scale Recurrent Neural Network for Sound Event Detection

Sound Event Detection Using Multi-Scale Dense Convolutional Recurrent Neural Network with Lightweight Attention

Multi-Scale Convolutional Recurrent Neural Network with Ensemble Method for Weakly Labeled Sound Event Detection

Adaptive Memory-Controlled Self-Attention for Polyphonic Sound Event Detection

Sound Event Localization and Detection Using Parallel Multi-attention Enhancement

MSFF-Net: Multi-scale Feature Fusing Networks with Dilated Mixed Convolution and Cascaded Parallel Framework for Sound Event Detection.

Improved Multi-Model Classification Technique for Sound Event Detection in Urban Environments

MTF-CRNN: Multiscale Time-Frequency Convolutional Recurrent Neural Network for Sound Event Detection.

NAS-DYMC: NAS-Based Dynamic Multi-Scale Convolutional Neural Network for Sound Event Detection

A Joint Detection-Classification Model for Weakly Supervised Sound Event Detection Using Multi-Scale Attention Method

Convolutional Recurrent Neural Networks with Multi-Sized Convolution Filters for Sound-Event Recognition

Sound Event Detection Via Conformer Recurrent Neural Networks

A Study of Improved Two-Stage Dual-Conv Coordinate Attention Model for Sound Event Detection and Localization

Multi-scale Convolutional Recurrent Neural Network and Data Augmentation for Polyphonic Sound Event Detection

Multi-dimensional frequency dynamic convolution with confident mean teacher for sound event detection

Polyphonic Sound Event Detection Using Temporal-Frequency Attention and Feature Space Attention

A Generalized Network Based on Multi-Scale Densely Connection and Residual Attention for Sound Source Localization and Detection.