Abstract:Phase information has a significant impact on speech perceptual quality and intelligibility. However, existing speech enhancement methods encounter limitations in explicit phase estimation due to the non-structural nature and wrapping characteristics of the phase, leading to a bottleneck in enhanced speech quality. To overcome the above issue, in this paper, we proposed MP-SENet, a novel Speech Enhancement Network that explicitly enhances Magnitude and Phase spectra in parallel. The proposed MP-SENet comprises a Transformer-embedded encoder-decoder architecture. The encoder aims to encode the input distorted magnitude and phase spectra into time-frequency representations, which are further fed into time-frequency Transformers for alternatively capturing time and frequency dependencies. The decoder comprises a magnitude mask decoder and a phase decoder, directly enhancing magnitude and wrapped phase spectra by incorporating a magnitude masking architecture and a phase parallel estimation architecture, respectively. Multi-level loss functions explicitly defined on the magnitude spectra, wrapped phase spectra, and short-time complex spectra are adopted to jointly train the MP-SENet model. A metric discriminator is further employed to compensate for the incomplete correlation between these losses and human auditory perception. Experimental results demonstrate that our proposed MP-SENet achieves state-of-the-art performance across multiple speech enhancement tasks, including speech denoising, dereverberation, and bandwidth extension. Compared to existing phase-aware speech enhancement methods, it further mitigates the compensation effect between the magnitude and phase by explicit phase estimation, elevating the perceptual quality of enhanced speech.

Simulation of the Multiband Excitation Encoder

Multiband Excitation Coding of Speech at 1.8 ～ 2.4 Kbps

New speech synthesis algorithm based on MBE

An Excitation Model Based On Inverse Filtering For Speech Analysis And Synthesis

A High Quality MBE-LPC-FE Speech Coder at 2.4 Kbps and 1.2 Kbps.

Research on MBE Algorithm at Bit Rate 800 Bps-2.4 Kbps Vocoder

Research on analysis and optimization of MBE

Simulations of the Convergence Performance of Several Bussgang Family Blind Equalization Algorithms

Application of Speech Coding Algorithm Based on MBE in Secure Communication

DCT_M Model for Excitation Parameter in Low Bit Rate Vocoder

Amplitude Spectrum Based Excitation Model For Hmm-Based Speech Synthesis

Investigation of IMBE Parameters' Sensitivity to Noise

The Realization of Acoustic Model Based on Noise Modulating for Cochlear Implantation

Model-Based Speech Enhancement in the Modulation Domain.

Multi-modal Speech Enhancement with Bone-Conducted Speech in Time Domain

Study and development of MELP vocoder

Realtime robust speech communication based on iterative joint source-channel decoding and demodulation algorithm for MELP vocoder

Explicit Estimation of Magnitude and Phase Spectra in Parallel for High-Quality Speech Enhancement

An Improved 2.4kb/s Mixed Excitation Linear Prediction Vocoder

SE Territory: Monaural Speech Enhancement Meets the Fixed Virtual Perceptual Space Mapping

A Speech Enhancement Algorithm Based on Computational Auditory Scene Analysis