Abstract:This paper proposes an innovative single-channel supervised speech enhancement (SE) method based on UNET, a convolutional neural network (CNN) architecture that expands on a few changes in the basic CNN architecture. In the training phase, short-time Fourier transform (STFT) is exploited on the noisy time domain signal to build a noisy time-frequency domain signal which is called a complex noisy matrix. We take the real and imaginary parts of the complex noisy matrix and concatenate both of them to form the noisy concatenated matrix. We apply UNET to the noisy concatenated matrix for extracting speech components and train the CNN model. In the testing phase, the same procedure is applied to the noisy time-domain signal as in the training phase in order to construct another noisy concatenated matrix that can be tested using a pre-trained or saved model in order to construct an enhanced concatenated matrix. Finally, from the enhanced concatenated matrix, we separate both the imaginary and real parts to form an enhanced complex matrix. Magnitude and phase are then extracted from the newly created enhanced complex matrix. By using that magnitude and phase, the inverse STFT (ISTFT) can generate the enhanced speech signal. Utilizing the IEEE databases and various types of noise, including stationary and non-stationary noise, the proposed method is evaluated. Comparing the exploratory results of the proposed algorithm to the other five methods of STFT, sparse non-negative matrix factorization (SNMF), dual-tree complex wavelet transform (DTCWT)-SNMF, DTCWT-STFT-SNMF, STFT-convolutional denoising auto encoder (CDAE) and casual multi-head attention mechanism (CMAM) for speech enhancement, we determine that the proposed algorithm generally improves speech quality and intelligibility at all considered signal-to-noise ratios (SNRs). The suggested approach performs better than the other five competing algorithms in every evaluation metric.

Research on Speech Enhancement Algorithm Based on SA-Unet

Time Domain Speech Enhancement Using Self-Attention-Based Subspace Projection

Audio Sentiment Analysis by Heterogeneous Signal Features Learned from Utterance-Based Parallel Neural Network.

Speech Enhancement Using U-Net with Compressed Sensing

Supervised Attention Multi-Scale Temporal Convolutional Network for monaural speech enhancement

Supervised Single Channel Speech Enhancement Method Using UNET

SMRU: Split-and-Merge Recurrent-based UNet for Acoustic Echo Cancellation and Noise Suppression

UNetGAN: A Robust Speech Enhancement Approach in Time Domain for Extremely Low Signal-to-Noise Ratio Condition

Blind Source Separation Based on Improved Wave-U-Net Network

Densely Connected Multi-Stage Model with Channel Wise Subband Feature for Real-Time Speech Enhancement.

Unseen Noise Estimation Using Separable Deep Auto Encoder for Speech Enhancement

VSANet: Real-time Speech Enhancement Based on Voice Activity Detection and Causal Spatial Attention

U-NET: A Supervised Approach for Monaural Source Separation

A Unified Speaker-Dependent Speech Separation and Enhancement System Based on Deep Neural Networks.

Multi-Channel Automatic Speech Recognition Using Deep Complex Unet

U-Former: Improving Monaural Speech Enhancement with Multi-head Self and Cross Attention

A Neural Network Approach for Speech Enhancement and Noise-Robust Bandwidth Extension

CAT-DUnet: Enhancing Speech Dereverberation via Feature Fusion and Structural Similarity Loss

LiSenNet: Lightweight Sub-band and Dual-Path Modeling for Real-Time Speech Enhancement

MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectra

A speech enhancement model based on noise component decomposition: Inspired by human cognitive behavior