Abstract:Single-channel speech separation can be adopted in many applications. Time-frequency (T-F) masking is an effective method for single-channel speech separation. With advancements in deep learning, T-F masks have become used as a training target, achieving notable separation results. Among the numerous masks that have been proposed, the ideal binary mask (IBM), ideal ratio mask (IRM), Wiener filter (WF) and spectral magnitude mask (SMM) are commonly used and have proven effective, though their separation performance varies depending on the speech mixture and separation model. The existing approach mainly utilizes a single network to approximate the mask of the target speech. However, in mixed speech, there are segments where speech is mixed with other speech, segments where speech is mixed with silent intervals, and segments where high signal-to-noise ratio (SNR) speech is mixed due to pauses and variations in the speakers' intonation and emphasis. In this paper, we attempt to use different networks to handle speech segments containing various mixtures. In addition to the existing network, we introduce a network (using the Rectified Linear Unit as activation functions) to specifically address segments containing a mixture of speech and silence, as well as segments with high SNR speech mixtures. We conducted evaluation experiments on the speech separation of two speakers using the four aforementioned masks as training targets. The performance improvements observed in the evaluation experiments demonstrate the effectiveness of our proposed method based on the joint network compared to the conventional method based on the single network.

A DNN Parameter Mask for the Binaural Reverberant Speech Segregation

A Binaural Deep Neural Networks Parameter Mask for the Robust Automatic Speech Recognition System

Parameter Masks for Close Talk Speech Segregation Using Deep Neural Networks

Binaural Classification for Reverberant Speech Segregation Using Deep Neural Networks

A regression approach to binaural speech segregation via deep neural network

Auditory Feature for Monaural Speech Segregation

Auditory Features For The Close Talk Speech Enhancement With Parameter Masks

Using an Adjustment Training and a Smoothing Mask for Speech Segregation

Speech separation based on reliable binaural cues with two-stage neural network in noisy-reverberant environments

A Dual Microphone Speech Enhancement Method With A Smoothing Parameter Mask

Joint Noise and Mask Aware Training for DNN-based Speech Enhancement with SUB-band Features

Joint Deep Neural Network for Single-Channel Speech Separation on Masking-Based Training Targets

Binaural Deep Neural Network for Robust Speech Enhancement

An Auditory-Based Monaural Feature for Noisy and Reverberant Speech Enhancement

An RNN-based Speech Enhancement Method for a Binaural Hearing Aid System

A Maximum Likelihood Approach to Deep Neural Network Based Speech Dereverberation

Speech Separation Based on Signal-Noise-dependent Deep Neural Networks for Robust Speech Recognition

A Unified DNN Approach to Speaker-Dependent Simultaneous Speech Enhancement and Speech Separation in Low SNR Environments

A Maximum Likelihood Approach to Deep Neural Network Based Nonlinear Spectral Mapping for Single-Channel Speech Separation

Joint Training for Simultaneous Speech Denoising and Dereverberation with Deep Embedding Representations

Simultaneous Denoising and Dereverberation Using Deep Embedding Features