Abstract:Time-frequency (T-F) masking is an effective method for stereo speech source separation. However, reliable estimation of the T-F mask from sound mixtures is a challenging task, especially when room reverberations are present in the mixtures. In this paper, we propose a new stereo speech separation system where deep neural networks are used to generate soft T-F mask for separation. More specifically, the deep neural network, which is composed of two sparse autoencoders and a softmax regression, is used to estimate the orientations of the dominant source at each T-F unit, based on low-level features, such as mixing vector (MV), interaural level, and phase difference (IPD/ILD). The dataset for training the networks was generated by the convolution of binaural room impulse responses (RIRs) and clean speech signals positioned in different angles with respect to the sensors. With the training dataset, we use unsupervised learning to extract high-level features from low-level features and use supervised learning to find the nonlinear functions between high-level features and the orientations of dominant source. By using the trained networks, the probability that each T-F unit belongs to different sources (target and interferers) can be estimated based on the localization cues which is further used to generate the soft mask for source separation. Experiments based on real binaural RIRs and TIMIT dataset are provided to show the performance of the proposed system for reverberant speech mixtures, as compared with a model-based T-F masking technique proposed recently.

Room Impulse Response Reshaping-Based Underdetermined Blind Source Separation in a Reverberant Environment

Room Impulse Response Reshaping-Based Expectation Maximization in an Underdetermined Reverberant Environment

Underdetermined Reverberant Audio-Source Separation Through Improved Expectation–Maximization Algorithm

Underdetermined Blind Source Separation in Reverberant Environment

Reverberant Speech Separation with Probabilistic Time-Frequency Masking for B-format Recordings.

Underdetermined Convolutive Blind Separation of Sources Integrating Tensor Factorization and Expectation Maximization.

SA-UCBSS: Sparsity-Based Adaptive Underdetermined Convolutive Blind Source Separation

A Blind Channel Identification-Based Two-Stage Approach to Separation and Dereverberation of Speech Signals in a Reverberant Environment

Localization Based Stereo Speech Separation Using Deep Networks.

A combined blind source separation and adaptive noise cancellation scheme with potential application in blind acoustic parameter extraction

Underdetermined Blind Source Separation of Speech Mixtures Based on K-means Clustering

Localization Based Stereo Speech Source Separation Using Probabilistic Time-Frequency Masking and Deep Neural Networks

Room Impulse Response Estimation in a Multiple Source Environment

A Mixing Matrix Estimation Algorithm for Underdetermined Blind Source Separation

Underdetermined Blind Separation Based on Sound Source Time-Delay Estimation

Underdetermined Blind Source Separation for Linear Instantaneous Mixing System in the Non-Cooperative Wireless Communication.

Acoustic parameter extraction from occupied rooms utilizing blind source separation

Quasi-Blind Source Separation Algorithm for Convolutive Mixture of Speech

Blind source separation of the fractional fourier domain in reverberation background

A New Mixing Matrix Identification Algorithm for Underdetermined Blind Source Separation

Stereophonic Acoustic Echo Cancellation Based on Semi-Blind Source Separation