Abstract:Typical speech separation systems usually operate in the time-frequency (T-F) domain by enhancing the magnitude response and leaving the phase response unaltered. Recent studies, however, suggest that phase is important for perceptual quality, leading many researchers to consider magnitude and phase spectrum enhancements. The complex-valued Fourier spectrum and real-valued shifted real spectrum (SRS) of a discrete-time speech signal sequence carry information both in magnitude and phase functions, which can reconstruct the speech signal without loss. In this paper, we propose novel methods called the pcIRM and pSRSM to solve the problem of speaker-independent monaural source separation and to recover the phase of source speech signal. Specifically, the pcIRM achieves the complex ideal ratio mask (cIRM) estimation based on the complex-valued phase-encoded Fourier spectrogram, and the pSRSM obtains the shifted real spectrum mask (SRSM) estimation based on the real-valued phase-encoded shifted real spectrum, both of which are creatively implemented with the deep bi-directional Long Short-Term Memory networks. Furthermore, the merging of these masking estimation methods and the utterance-level permutation invariant training (uPIT) approach has been proved to be an effective way to improve speech separation. Typically, the uPIT addresses the label ambiguity problem well, which is the major barrier for speaker-independent multi-talker source separation. Finally, we report separation results for the proposed methods and compare them with that of the state-of-the-art methods, which are evaluated with the WSJ0-2mix datasets. Extensive experiment results demonstrate the advantages of our proposed pcIRM method in terms of the signal-to-distortion ratio (SDR) and the perceptual evaluation of speech quality (PESQ) metrics, and the pSRSM method obtains comparable performance to the pcIRM in the opposite gender speakers source separation circumstance with smaller model complexity.

Single channel signal separation based on correlation enhancement

Single-channel speech separation based on pitch state and interframe correlation

Adaptive Beamforming Based on Interference-Plus-Noise Covariance Matrix Reconstruction for Speech Separation

Single Channel Speech Dereverberation and Separation Using RPCA and SNMF

Single-Channel Speech Separation Based on Long-Short Frame Associated Harmonic Model

Cepstral Smoothing of Spectral Masks for Acoustic Vector-Sensor Based Convolutive Speech Separation

Enhancement of Single-Channel Periodic Signals in the Time-Domain

Single-Channel Signal Separation Using Spectral Basis Correlation with Sparse Nonnegative Tensor Factorization

Reverberant Speech Separation with Probabilistic Time-Frequency Masking for B-format Recordings.

Single-channel Blind Separation of Co-Frequency Signals Based on Convolutional Network

Incorporating Phase-Encoded Spectrum Masking into Speaker-Independent Monaural Source Separation

Single channel informed signal separation using artificial‐stereophonic mixtures and exemplar‐guided matrix factor deconvolution

A Robust Unsupervised Method for the Single Channel Speech Separation.

A Regression Approach to Single-Channel Speech Separation Via High-Resolution Deep Neural Networks.

Generative adversarial networks for single channel separation of convolutive mixed speech signals

An End-to-End Speech Separation Method Based on Features of Two Domains

Cochannel Speech Separation Using Multi-Pitch Estimation and Model Based Voiced Sequential Grouping.

Single Channel Signal Component Separation Using Bayesian Estimation

A feature study for classification-based speech separation at low signal-to-noise ratios

Adaptive Speech Separation Based on Beamforming and Frequency Domain-Independent Component Analysis

An Improved Unsupervised Single-Channel Speech Separation Algorithm for Processing Speech Sensor Signals.