Abstract:Sound Event Detection and Localization (SELD) is a comprehensive task that aims to solve the subtasks of Sound Event Detection (SED) and Sound Source Localization (SSL) simultaneously. The task of SELD lies in the need to solve both sound recognition and spatial localization problems, and different categories of sound events may overlap in time and space, making it more difficult for the model to distinguish between different events occurring at the same time and to locate the sound source. In this study, the Dual-conv Coordinate Attention Module (DCAM) combines dual convolutional blocks and Coordinate Attention, and based on this, the network architecture based on the two-stage strategy is improved to form the SELD-oriented Two-Stage Dual-conv Coordinate Attention Model (TDCAM) for SELD. TDCAM draws on the concepts of Visual Geometry Group (VGG) networks and Coordinate Attention to effectively capture critical local information by focusing on the coordinate space information of the feature map and dealing with the relationship between the feature map channels to enhance the feature selection capability of the model. To address the limitation of a single-layer Bi-directional Gated Recurrent Unit (Bi-GRU) in the two-stage network in terms of timing processing, we add to the structure of the two-layer Bi-GRU and introduce the data enhancement techniques of the frequency mask and time mask to improve the modeling and generalization ability of the model for timing features. Through experimental validation on the TAU Spatial Sound Events 2019 development dataset, our approach significantly improves the performance of SELD compared to the two-stage network baseline model. Furthermore, the effectiveness of DCAM and the two-layer Bi-GRU structure is confirmed by performing ablation experiments.

Sound Event Detection Based on Bidirectional Temporal Convolutional Network and Gated Recurrent Unit

Automatic Respiratory Sound Classification Via Multi-Branch Temporal Convolutional Network

MTF-CRNN: Multiscale Time-Frequency Convolutional Recurrent Neural Network for Sound Event Detection.

Sound Event Detection Using Spatial Features and Convolutional Recurrent Neural Network

Multi-Scale Convolutional Recurrent Neural Network with Ensemble Method for Weakly Labeled Sound Event Detection

Dilated-Gated Convolutional Neural Network with A New Loss Function on Sound Event Detection.

Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection

Decoupling Temporal Convolutional Networks Model in Sound Event Detection and Localization

End-to-End Polyphonic Sound Event Detection Using Convolutional Recurrent Neural Networks with Learned Time-Frequency Representation Input

Multi-Scale Recurrent Neural Network for Sound Event Detection

MULTI-SCALE CONVOLUTION BASED ATTENTION NETWORK FOR SEMI-SUPERVISED SOUND EVENT DETECTION Technical Report

Multi-scale Convolutional Recurrent Neural Network and Data Augmentation for Polyphonic Sound Event Detection

A Multi-grained based Attention Network for Semi-supervised Sound Event Detection

Convolutional bidirectional long short-term memory hidden Markov model hybrid system for polyphonic sound event detection

Sound event detection via dilated convolutional recurrent neural networks

Hierarchical-Concatenate Fusion TDNN for sound event classification

Sound event localization and detection based on crnn using rectangular filters and channel rotation data augmentation

Using Deep Belief Network to Capture Temporal Information for Audio Event Classification.

A Study of Improved Two-Stage Dual-Conv Coordinate Attention Model for Sound Event Detection and Localization

U Recurrent Neural Network for Polyphonic Sound Event Detection and Localization

Auditory Neural Response Inspired Sound Event Detection Based on Spectro-temporal Receptive Field