Abstract:Time-frequency (T-F) masking is an effective method for stereo speech source separation. However, reliable estimation of the T-F mask from sound mixtures is a challenging task, especially when room reverberations are present in the mixtures. In this paper, we propose a new stereo speech separation system where deep neural networks are used to generate soft T-F mask for separation. More specifically, the deep neural network, which is composed of two sparse autoencoders and a softmax regression, is used to estimate the orientations of the dominant source at each T-F unit, based on low-level features, such as mixing vector (MV), interaural level, and phase difference (IPD/ILD). The dataset for training the networks was generated by the convolution of binaural room impulse responses (RIRs) and clean speech signals positioned in different angles with respect to the sensors. With the training dataset, we use unsupervised learning to extract high-level features from low-level features and use supervised learning to find the nonlinear functions between high-level features and the orientations of dominant source. By using the trained networks, the probability that each T-F unit belongs to different sources (target and interferers) can be estimated based on the localization cues which is further used to generate the soft mask for source separation. Experiments based on real binaural RIRs and TIMIT dataset are provided to show the performance of the proposed system for reverberant speech mixtures, as compared with a model-based T-F masking technique proposed recently.

Binaural Classification for Reverberant Speech Segregation Using Deep Neural Networks

A regression approach to binaural speech segregation via deep neural network

A DNN Parameter Mask for the Binaural Reverberant Speech Segregation

Auditory Feature for Monaural Speech Segregation

Deep Neural Network Based Environment Sound Classification and Its Implementation on Hearing Aid App

Deep Neural Network Based Audio Source Separation

Localization Based Stereo Speech Source Separation Using Probabilistic Time-Frequency Masking and Deep Neural Networks

Deep Learning Applied to Dereverberation and Sound Event Classification in Reverberant Environments

Localization Based Stereo Speech Separation Using Deep Networks.

Binaural Speech Enhancement Based On Dnn For The Application Of Virtual Reality

Binaural Deep Neural Network for Robust Speech Enhancement

Speech separation based on reliable binaural cues with two-stage neural network in noisy-reverberant environments

Exploiting Deep Neural Networks and Head Movements for Robust Binaural Localisation of Multiple Sources in Reverberant Environments

A Deep Ensemble Learning Method for Monaural Speech Separation.

A Unified DNN Approach to Speaker-Dependent Simultaneous Speech Enhancement and Speech Separation in Low SNR Environments

An Auditory-Based Monaural Feature for Noisy and Reverberant Speech Enhancement

Using an Adjustment Training and a Smoothing Mask for Speech Segregation

Parameter Masks for Close Talk Speech Segregation Using Deep Neural Networks

Convolutive Prediction for Monaural Speech Dereverberation and Noisy-Reverberant Speaker Separation

Speech Separation Based on Signal-Noise-dependent Deep Neural Networks for Robust Speech Recognition

A Unified Speaker-Dependent Speech Separation and Enhancement System Based on Deep Neural Networks.