Abstract:Phase information has a significant impact on speech perceptual quality and intelligibility. However, existing speech enhancement methods encounter limitations in explicit phase estimation due to the non-structural nature and wrapping characteristics of the phase, leading to a bottleneck in enhanced speech quality. To overcome the above issue, in this paper, we proposed MP-SENet, a novel Speech Enhancement Network that explicitly enhances Magnitude and Phase spectra in parallel. The proposed MP-SENet comprises a Transformer-embedded encoder-decoder architecture. The encoder aims to encode the input distorted magnitude and phase spectra into time-frequency representations, which are further fed into time-frequency Transformers for alternatively capturing time and frequency dependencies. The decoder comprises a magnitude mask decoder and a phase decoder, directly enhancing magnitude and wrapped phase spectra by incorporating a magnitude masking architecture and a phase parallel estimation architecture, respectively. Multi-level loss functions explicitly defined on the magnitude spectra, wrapped phase spectra, and short-time complex spectra are adopted to jointly train the MP-SENet model. A metric discriminator is further employed to compensate for the incomplete correlation between these losses and human auditory perception. Experimental results demonstrate that our proposed MP-SENet achieves state-of-the-art performance across multiple speech enhancement tasks, including speech denoising, dereverberation, and bandwidth extension. Compared to existing phase-aware speech enhancement methods, it further mitigates the compensation effect between the magnitude and phase by explicit phase estimation, elevating the perceptual quality of enhanced speech.

Speech Enhancement Based On Analysis Synthesis Framework With Improved Pitch Estimation And Spectral Envelope Enhancement

Speech Enhancement Based on Analysis–Synthesis Framework with Improved Parameter Domain Enhancement

Pitch-scaled Analysis Based Residual Reconstruction for Speech Analysis and Synthesis

Online Monaural Speech Enhancement Based on Periodicity Analysis and A Priori SNR Estimation

A Speech Enhancement Algorithm Based on Computational Auditory Scene Analysis

Investigation of the Spectral Envelope Estimation Vocoder and Improved Pitch Estimation Based on the Sinusoidal Speech Model

An initial research: Towards accurate pitch extraction for speech synthesis based on BLSTM

A Speech Enhancement Algorithm Using Computational Auditory Scene Analysis with Spectral Subtraction

A Refining Underlying Information Framework for Monaural Speech Enhancement

Speech Enhancement Approach Based on Minimum Estimate and Spectral Subtraction

Speech Enhancement Based on Binaural Sound Source Localization and Cosh Measure Wiener Filtering

Single-channel speech enhancement by using psychoacoustical model inspired fusion framework

Phase Spectrum Recovery for Enhancing Low-Quality Speech Captured by Laser Microphones

Speech Enhancement with Perceptually-motivated Optimization and Dual Transformations

Explicit Estimation of Magnitude and Phase Spectra in Parallel for High-Quality Speech Enhancement

A Robust and Low Computational Cost Pitch Estimation Method

Densely Connected Multi-Stage Model with Channel Wise Subband Feature for Real-Time Speech Enhancement.

MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectra

MF-PAM: Accurate Pitch Estimation through Periodicity Analysis and Multi-level Feature Fusion

Speech Enhancement Using Non-Negative Spectrogram Models With Mel-Generalized Cepstral Regularization

A Joint Framework of Denoising Autoencoder and Generative Vocoder for Monaural Speech Enhancement