Abstract:Typical speech separation systems usually operate in the time-frequency (T-F) domain by enhancing the magnitude response and leaving the phase response unaltered. Recent studies, however, suggest that phase is important for perceptual quality, leading many researchers to consider magnitude and phase spectrum enhancements. The complex-valued Fourier spectrum and real-valued shifted real spectrum (SRS) of a discrete-time speech signal sequence carry information both in magnitude and phase functions, which can reconstruct the speech signal without loss. In this paper, we propose novel methods called the pcIRM and pSRSM to solve the problem of speaker-independent monaural source separation and to recover the phase of source speech signal. Specifically, the pcIRM achieves the complex ideal ratio mask (cIRM) estimation based on the complex-valued phase-encoded Fourier spectrogram, and the pSRSM obtains the shifted real spectrum mask (SRSM) estimation based on the real-valued phase-encoded shifted real spectrum, both of which are creatively implemented with the deep bi-directional Long Short-Term Memory networks. Furthermore, the merging of these masking estimation methods and the utterance-level permutation invariant training (uPIT) approach has been proved to be an effective way to improve speech separation. Typically, the uPIT addresses the label ambiguity problem well, which is the major barrier for speaker-independent multi-talker source separation. Finally, we report separation results for the proposed methods and compare them with that of the state-of-the-art methods, which are evaluated with the WSJ0-2mix datasets. Extensive experiment results demonstrate the advantages of our proposed pcIRM method in terms of the signal-to-distortion ratio (SDR) and the perceptual evaluation of speech quality (PESQ) metrics, and the pSRSM method obtains comparable performance to the pcIRM in the opposite gender speakers source separation circumstance with smaller model complexity.

Performance analysis of ideal binary masks in speech enhancement

Performance of Binary Time-Frequency Masks in Low Signal to Noise Ratio Environments

Improvement of intelligibility of ideal binary-masked noisy speech by adding background noise.

Impact of Mask Type as Training Target for Speech Intelligibility and Quality in Cochlear-Implant Noise Reduction

Auditory Feature for Monaural Speech Segregation

Is the Ideal Ratio Mask Really the Best? -- Exploring the Best Extraction Performance and Optimal Mask of Mask-based Beamformers

Using an Adjustment Training and a Smoothing Mask for Speech Segregation

A DNN Parameter Mask for the Binaural Reverberant Speech Segregation

Phoneme-Based Ratio Mask Estimation for Reverberant Speech Enhancement in Cochlear Implant Processors

A Speech Enhancement Algorithm Based on Computational Auditory Scene Analysis

Effect of enhancement of spectral changes on speech intelligibility and clarity preferences for the hearing impaired.

Incorporating Phase-Encoded Spectrum Masking into Speaker-Independent Monaural Source Separation

A Dual Microphone Speech Enhancement Method With A Smoothing Parameter Mask

Millimeter Wave Conduct Speech Enhancement Based on Auditory Masking Properties

A Computational Model for Assessment of Speech Intelligibility in Informational Masking

An Improved Metric of Informational Masking for Perceptual Audio Quality Measurement

Time-Frequency Masking for Speech Separation and Its Potential for Hearing Aid Design

Comparison of Conventional Enhancement and Separation Methods in Indoor Environments.

Energy Difference Based Speech Segregation for Close-Talk System

A Binaural Deep Neural Networks Parameter Mask for the Robust Automatic Speech Recognition System

New insights on the optimality of parameterized wiener filters for speech enhancement applications