Abstract:As a key component of in-vehicle intelligent voice technology, speech enhancement can extract clean speech signals contaminated by environmental noise to improve the perceptual quality and intelligibility of speech. It has extensive applications in the field of intelligent car cabins. Although some end-to-end speech enhancement methods based on time domain have been proposed, there is often limited consideration given to designing model architectures based on the characteristics of the speech signal. In this paper, we propose a new U-Net based speech enhancement framework that utilizes the temporal correlation of speech signals to reconstruct higher-quality and more intelligible clean speech. Firstly, to address the issue of inadequate extraction of multi-scale correlation features from speech signals during feature extraction and reconstruction, a novel dense connection multi-scale feature extraction module based on gated dilated convolution is devised to enhance temporal receptive length and extract diverse scale features effectively. Secondly, in order to tackle the problem of feature loss and harmonic distortion during sampling, a sophisticated pooling-reconstruction fine-grained sampling method based on feature map recombination is proposed. This method aims to minimize information loss during down-sampling while simultaneously enhancing the clarity of reconstructed waveforms during up-sampling. Lastly, leveraging the aforementioned pooling-reconstruction sampling method, we propose a deep supervision approach for multi-scale feature. This approach effective supervision of perception characteristics across different frequency ranges. In order to validate the effectiveness of the proposed framework, experiments were conducted on the Voicebank+Demand dataset. The results show that compared to other advanced algorithms, the proposed model significantly improves metrics such as PESQ, STOI, CSIG, CBAK, and COVL. Even in low SNR environments, the enhanced speech signals exhibit noticeable improvements in quality and intelligibility. This is beneficial for subsequent automotive voice applications.

A Refining Underlying Information Framework for Monaural Speech Enhancement

A Refining Underlying Information Framework for Speech Enhancement

VoiCor: A Residual Iterative Voice Correction Framework for Monaural Speech Enhancement

Speech Enhancement with Perceptually-motivated Optimization and Dual Transformations

Filtering and Refining: A Collaborative-Style Framework for Single-Channel Speech Enhancement.

Densely Connected Multi-Stage Model with Channel Wise Subband Feature for Real-Time Speech Enhancement.

Monaural Speech Enhancement with Deep Residual-Dense Lattice Network and Attention Mechanism in the Time Domain

Improving Deep Neural Network Based Speech Enhancement in Low SNR Environments

Two Heads Are Better Than One: A Two-Stage Complex Spectral Mapping Approach for Monaural Speech Enhancement.

Perceptually Guided Speech Enhancement Using Deep Neural Networks

A Modified Speech Enhancement Algorithm Using a Universal Speaker Model

Multi-scale Informative Perceptual Network for Monaural Speech Enhancement

Improving Monaural Speech Enhancement with Dynamic Scene Perception Module

Know Your Enemy, Know Yourself: A Unified Two-Stage Framework for Speech Enhancement

Speech enhancement from fused features based on deep neural network and gated recurrent unit network

Speech enhancement based on emphasizing the fundamental frequency integrated with SNMF/DNN

A New U-Net Speech Enhancement Framework Based on Correlation Characteristics of Speech

Dual-stream Noise and Speech Information Perception based Speech Enhancement

A Lightweight and Real-Time Binaural Speech Enhancement Model with Spatial Cues Preservation

Plugin Speech Enhancement: A Universal Speech Enhancement Framework Inspired by Dynamic Neural Network

Speech Enhancement Algorithm Using Wiener Filtering Based on Improved Energy to Entropy Ratio