Abstract:Time-frequency (T-F) masking is an effective method for stereo speech source separation. However, reliable estimation of the T-F mask from sound mixtures is a challenging task, especially when room reverberations are present in the mixtures. In this paper, we propose a new stereo speech separation system where deep neural networks are used to generate soft T-F mask for separation. More specifically, the deep neural network, which is composed of two sparse autoencoders and a softmax regression, is used to estimate the orientations of the dominant source at each T-F unit, based on low-level features, such as mixing vector (MV), interaural level, and phase difference (IPD/ILD). The dataset for training the networks was generated by the convolution of binaural room impulse responses (RIRs) and clean speech signals positioned in different angles with respect to the sensors. With the training dataset, we use unsupervised learning to extract high-level features from low-level features and use supervised learning to find the nonlinear functions between high-level features and the orientations of dominant source. By using the trained networks, the probability that each T-F unit belongs to different sources (target and interferers) can be estimated based on the localization cues which is further used to generate the soft mask for source separation. Experiments based on real binaural RIRs and TIMIT dataset are provided to show the performance of the proposed system for reverberant speech mixtures, as compared with a model-based T-F masking technique proposed recently.

Deconvolution-based Acoustic Source Localization and Separation Algorithms

Acoustic Source Localization and Deconvolution-Based Separation

A New Seperation Method for Rotationg and Static Sound Source Localization

A robust super-resolution approach with sparsity constraint for near-field wideband acoustic imaging

Time Difference of Arrival-Based Acoustic Source Localization and Separation Technique for Sparse Arrays

Acoustic Source Localization in a Reverberant Environment Based on Sound Field Morphological Component Analysis and Alternating Direction Method of Multipliers

Localization Based Stereo Speech Separation Using Deep Networks.

Localization Based Stereo Speech Source Separation Using Probabilistic Time-Frequency Masking and Deep Neural Networks

A Two Microphone-Based Approach For Source Localization Of Multiple Speech Sources

Time Difference of Arrival (Tdoa)-Based Acoustic Source Localization and Signal Extraction for Intelligent Audio Classification.

Localization and Separation of Acoustic Sources by Using a 2.5-Dimensional Circular Microphone Array

Leveraging Moving Sound Source Trajectories for Universal Sound Separation

Multi-Source Localization and Signal Extraction Using a Proximal Gradient-based Compressed Sensing Approach

An online blind source separation for convolutive acoustic signals in frequency-domain

Acoustic Source Localization Based on Geometric Projection in Reverberant and Noisy Environments

Underdetermined Reverberant Audio-Source Separation Through Improved Expectation–Maximization Algorithm

Joint DOA Estimation and Dereverberation Based on Multi-Channel Linear Prediction Filtering and Azimuth Sparsity

Acoustic Source Localization Based On Multichannel Compressed Sensing And Auditory Bionics In Hearing Aids

Expectation-maximisation for Speech Source Separation Using Convolutive Transfer Function

Towards Robust Multiple Blind Source Localization Using Source Separation and Beamforming

Underdetermined Blind Source Separation in Reverberant Environment