Abstract:The systematic evaluation of speech separation and enhancement models under moving sound source conditions typically requires extensive data comprising diverse scenarios. However, real-world datasets often contain insufficient data to meet the training and evaluation requirements of models. Although synthetic datasets offer a larger volume of data, their acoustic simulations lack realism. Consequently, neither real-world nor synthetic datasets effectively fulfill practical needs. To address these issues, we introduce SonicSim, a synthetic toolkit de-designed to generate highly customizable data for moving sound sources. SonicSim is developed based on the embodied AI simulation platform, Habitat-sim, supporting multi-level adjustments, including scene-level, microphone-level, and source-level, thereby generating more diverse synthetic data. Leveraging SonicSim, we constructed a moving sound source benchmark dataset, SonicSet, using the Librispeech, the Freesound Dataset 50k (FSD50K) and Free Music Archive (FMA), and 90 scenes from the Matterport3D to evaluate speech separation and enhancement models. Additionally, to validate the differences between synthetic data and real-world data, we randomly selected 5 hours of raw data without reverberation from the SonicSet validation set to record a real-world speech separation dataset, which was then compared with the corresponding synthetic datasets. Similarly, we utilized the real-world speech enhancement dataset RealMAN to validate the acoustic gap between other synthetic datasets and the SonicSet dataset for speech enhancement. The results indicate that the synthetic data generated by SonicSim can effectively generalize to real-world scenarios. Demo and code are publicly available at <a class="link-external link-https" href="https://cslikai.cn/SonicSim/" rel="external noopener nofollow">this https URL</a>.

Methods of sound source extraction for audio system of flight simulator

Technologies of sound analysis and synthesis for audio system of flight simulator

Sound Analysis and Synthesis for Audio Simulation System of Flight Simulator

Development of 3D Sound Simulation System for Flight Simulator

Simulation and Realization of 3D Sound for Flight Simulator

A 3D sound simulation system for flight simulator

Hybrid Method of Image Source Model and Diffuse Surface Integration for the Simulation of Room Sound Field

An Audio Generator System For Experimental Studies On Acoustic Biology

Sound Field Separating on Arbitrary Surfaces Enclosing a Sound Scatterer Based on Combined Integral Equations.

Acoustic Source Localization in a Reverberant Environment Based on Sound Field Morphological Component Analysis and Alternating Direction Method of Multipliers

Audio Simulation for Sound Source Localization in Virtual Evironment

Simplified model for generating 3D realistic sound in the multimedia and virtual reality systems

SonicSim: A customizable simulation platform for speech processing in moving sound source scenarios

Sound sources identification for machine acoustic signals based on combined wave superposition method

Audio Simulation for Sound Source Localization in Virtual Environment

Acoustical Source Separation and Identification Using Principal Component Analysis and Correlation Analysis

MECHANICAL NOISE FEATURE EXTRACTION BASED ON WAVE SUPERPOSITION METHOD

Theoretical and Experimental Study on Sound Source Identification Based on Combined Wave Superposition Method

Separate Anything You Describe

Acoustic Source Localization and Deconvolution-Based Separation

Blind source separation for aero-engines vibration signal by independent component analysis