Abstract:The systematic evaluation of speech separation and enhancement models under moving sound source conditions typically requires extensive data comprising diverse scenarios. However, real-world datasets often contain insufficient data to meet the training and evaluation requirements of models. Although synthetic datasets offer a larger volume of data, their acoustic simulations lack realism. Consequently, neither real-world nor synthetic datasets effectively fulfill practical needs. To address these issues, we introduce SonicSim, a synthetic toolkit de-designed to generate highly customizable data for moving sound sources. SonicSim is developed based on the embodied AI simulation platform, Habitat-sim, supporting multi-level adjustments, including scene-level, microphone-level, and source-level, thereby generating more diverse synthetic data. Leveraging SonicSim, we constructed a moving sound source benchmark dataset, SonicSet, using the Librispeech, the Freesound Dataset 50k (FSD50K) and Free Music Archive (FMA), and 90 scenes from the Matterport3D to evaluate speech separation and enhancement models. Additionally, to validate the differences between synthetic data and real-world data, we randomly selected 5 hours of raw data without reverberation from the SonicSet validation set to record a real-world speech separation dataset, which was then compared with the corresponding synthetic datasets. Similarly, we utilized the real-world speech enhancement dataset RealMAN to validate the acoustic gap between other synthetic datasets and the SonicSet dataset for speech enhancement. The results indicate that the synthetic data generated by SonicSim can effectively generalize to real-world scenarios. Demo and code are publicly available at <a class="link-external link-https" href="https://cslikai.cn/SonicSim/" rel="external noopener nofollow">this https URL</a>.

The 2010 Signal Separation Evaluation Campaign (SiSEC2010): Audio Source Separation

The 2010 Signal Separation Evaluation Campaign (SiSEC2010): Biomedical Source Separation

The Signal Separation Evaluation Campaign (2007-2010): Achievements and Remaining Challenges.

The 2018 Signal Separation Evaluation Campaign

Benchmarks and leaderboards for sound demixing tasks

Investigating Self-Supervised Learning for Speech Enhancement and Separation

Experiments on Blind Speech Separations

SonicSim: A customizable simulation platform for speech processing in moving sound source scenarios

A comprehensive study of speech separation: spectrogram vs waveform separation

A Benchmark of State-of-the-Art Sound Event Detection Systems Evaluated on Synthetic Soundscapes

Analysis and interpretation of joint source separation and sound event detection in domestic environments

Separate Anything You Describe

Speech Enhancement Using Open-Unmix Music Source Separation Architecture

Implementation of Sound Direction Detection and Mixed Source Separation in Embedded Systems

Two-stage Model and Optimal SI-SNR for Monaural Multi-Speaker Speech Separation in Noisy Environment

Optimal Scale-Invariant Signal-to-noise Ratio and Curriculum Learning for Monaural Multi-Speaker Speech Separation in Noisy Environment.

Deconvolution-based Acoustic Source Localization and Separation Algorithms

Exploring Text-Queried Sound Event Detection with Audio Source Separation

Acoustic Source Localization and Deconvolution-Based Separation

OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup