Abstract:Sound Event Detection and Localization (SELD) is a comprehensive task that aims to solve the subtasks of Sound Event Detection (SED) and Sound Source Localization (SSL) simultaneously. The task of SELD lies in the need to solve both sound recognition and spatial localization problems, and different categories of sound events may overlap in time and space, making it more difficult for the model to distinguish between different events occurring at the same time and to locate the sound source. In this study, the Dual-conv Coordinate Attention Module (DCAM) combines dual convolutional blocks and Coordinate Attention, and based on this, the network architecture based on the two-stage strategy is improved to form the SELD-oriented Two-Stage Dual-conv Coordinate Attention Model (TDCAM) for SELD. TDCAM draws on the concepts of Visual Geometry Group (VGG) networks and Coordinate Attention to effectively capture critical local information by focusing on the coordinate space information of the feature map and dealing with the relationship between the feature map channels to enhance the feature selection capability of the model. To address the limitation of a single-layer Bi-directional Gated Recurrent Unit (Bi-GRU) in the two-stage network in terms of timing processing, we add to the structure of the two-layer Bi-GRU and introduce the data enhancement techniques of the frequency mask and time mask to improve the modeling and generalization ability of the model for timing features. Through experimental validation on the TAU Spatial Sound Events 2019 development dataset, our approach significantly improves the performance of SELD compared to the two-stage network baseline model. Furthermore, the effectiveness of DCAM and the two-layer Bi-GRU structure is confirmed by performing ablation experiments.

Sound Event Localization and Detection Based on Multiple DOA Beamforming and Multi-Task Learning

Sound Event Localization and Detection Based on Deep Learning

Sound Event Localization and Detection Based on Iterative Separation in Embedding Space

Polyphonic Sound Event Detection and Localization using a Two-Stage Strategy

Sound Event Detection and Localization with Distance Estimation

A Model Ensemble Approach for Sound Event Localization and Detection.

A Study of Improved Two-Stage Dual-Conv Coordinate Attention Model for Sound Event Detection and Localization

Two vs. Four-Channel Sound Event Localization and Detection

Improving Sound Event Localization and Detection with Class-Dependent Sound Separation for Real-World Scenarios

An Improved Event-Independent Network for Polyphonic Sound Event Localization and Detection

Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks

Joint Spatio-Temporal-Frequency Representation Learning for Improved Sound Event Localization and Detection

Sound Event Localization and Detection Using Parallel Multi-attention Enhancement

What Makes Sound Event Localization and Detection Difficult? Insights from Error Analysis

The NERCSLIP-USTC System for the L3DAS23 Challenge Task2: 3D Sound Event Localization and Detection (SELD)

Learning Multi-Target TDOA Features for Sound Event Localization and Detection

Sound Event Localization and Detection Using Activity-Coupled Cartesian DOA Vector and RD3net

Sound Event Localization and Detection Using a Spatial Omni-Dimensional Dynamic Interactions Network

DOA-Aware Audio-Visual Self-Supervised Learning for Sound Event Localization and Detection

Sound Event Localization based on Sound Intensity Vector Refined By DNN-Based Denoising and Source Separation

ICASSP 2022 L3DAS22 Challenge: Ensemble of Resnet-Conformers with Ambisonics Data Augmentation for Sound Event Localization and Detection