Abstract:Supervised speech enhancement has gained significantly from recent advancements in neural networks, especially due to their ability to non-linearly fit the diverse representations of target speech, such as waveform or spectrum. However, these direct-fitting solutions continue to face challenges with degraded speech and residual noise in hearing evaluations. By bridging the speech enhancement and the Information Bottleneck principle in this letter, we rethink a universal plug-and-play strategy and propose a Refining Underlying Information framework called RUI to rise to the challenges both in theory and practice. Specifically, we first transform the objective of speech enhancement into an incremental convergence problem of mutual information between comprehensive speech characteristics and individual speech characteristics, e.g., spectral and acoustic characteristics. By doing so, compared with the existing direct-fitting solutions, the underlying information stems from the conditional entropy of acoustic characteristic given spectral characteristics. Therefore, we design a dual-path multiple refinement iterator based on the chain rule of entropy to refine this underlying information for further approximating target speech. Experimental results on DNS-Challenge dataset show that our solution consistently improves 0.3+ PESQ score over baselines, with only additional 1.18 M parameters. The source code is available at <a class="link-external link-https" href="https://github.com/caoruitju/RUI_SE" rel="external noopener nofollow">this https URL</a>.

Higher intelligibility subspace speech-enhancement algorithm

A Modified Speech Enhancement Algorithm Using a Universal Speaker Model

Subspace-based Speech Enhancement and Implementation

Enhancement Algorithm for Low Signal to Noise Ratio Speech

Speech Enhancement Algorithm Based on Spectral Subtraction

A Higher Order Subspace Algorithm for Multichannel Speech Enhancement

A Speech Enhancement Algorithm Based on Computational Auditory Scene Analysis

Speech Enhancement Based on Short-Time Spectral Amplitude Estimates in Low SNR

A Subspace Method For Speech Enhancement In The Modulation Domain

An eigenvalue filtering based subspace approach for speech enhancement

Sub-band Adaptive Noise Reduction Algorithm to Improve Speech Intelligibility

A GSC Algorithm Based on Null Spectral Subtraction for Dual Small Microphone Array Speech Enhancement

Speech Enhancement for Non-Stationary Noise Environments

Improved Speech Enhancement Algorithm Based on Short-Time Spectral Analysis

Spectral-change Enhancement with Prior SNR for the Hearing Impaired

A Speech Enhancement Algorithm Using Computational Auditory Scene Analysis with Spectral Subtraction

Speech enhancement based on estimating expected values of speech cepstra

An Application of the Subspace Approach on Radar Speech Enhancement.

A Refining Underlying Information Framework for Monaural Speech Enhancement

Speech Enhancement Algorithm Using Wiener Filtering Based on Improved Energy to Entropy Ratio

Adaptive two-channel speech enhancement algorithm based on the modulation spectrum