Abstract:In this paper, we propose a novel speech enhancement method based on dual-tree complex wavelet transforms (DTCWT) and nonnegative matrix factorization (NMF) that exploits the subband smooth ratio mask (ssRM) through a joint learning process. The discrete wavelet packet transform (DWPT) suffers the absence of shift invariance, due to downsampling after the filtering process, resulting in a reconstructed signal with significant noise. The redundant stationary wavelet transform (SWT) can solve this shift invariance problem. In this respect, we use efficient DTCWT with a shift invariance property and limited redundancy and calculate the ratio masks (RMs) between the clean training speech and noisy speech (i.e., training noise mixed with clean speech). We also compute RMs between the noise and noisy speech and then learn both RMs with their corresponding clean training clean speech and noise. The auto-regressive moving average (ARMA) filtering process is applied before NMF in previously generated matrices for smooth decomposition. An ssRM is proposed to exploit the advantage of the joint use of the standard ratio mask (sRM) and square root ratio mask (srRM). In short, the DTCWT produces a set of subband signals employing the time-domain signal. Subsequently, the framing scheme is applied to each subband signal to form matrices and calculates the RMs before concatenation with the previously generated matrices. The ARMA filter is implemented in the nonnegative matrix, which is formed by considering the absolute value. Through ssRM, speech components are detected using NMF in each newly formed matrix. Finally, the enhanced speech signal is obtained via the inverse DTCWT (IDTCWT). The performances are evaluated by considering an IEEE corpus, the GRID audio-visual corpus, and different types of noises. The proposed approach significantly improves objective speech quality and intelligibility and outperforms the conventional STFT-NMF, DWPT-NMF, and DNN-IRM methods.

Correlation Weighting Enhancement of Speech Based on Multitaper Spectrum

Enhancement of Non-air Conduct Speech Based on Multi-band Spectral Subtraction Method

Noise Estimation Based on Time–frequency Correlation for Speech Enhancement

Enhancement Algorithm for Low Signal to Noise Ratio Speech

Noise reduction using wavelet thresholding of multitaper estimators and geometric approach to spectral subtraction for speech coding strategy

The Application of Perceptual Weighting on Millimeter Wave Conducted Speech Enhancement

Improved Speech Enhancement Algorithm Based on Short-Time Spectral Analysis

Speech enhancement based on adaptive averaging periodogram

Supervised Single Channel Speech Enhancement Based on Dual-Tree Complex Wavelet Transforms and Nonnegative Matrix Factorization Using the Joint Learning Process and Subband Smooth Ratio Mask

Enhancement of Non-Air Conducted Speech Based on Wavelet-Packet Adaptive Threshold

Online Monaural Speech Enhancement Based on Periodicity Analysis and A Priori SNR Estimation

Speech Enhancement Based on Short-Time Spectral Amplitude Estimates in Low SNR

An Improved Speech Enhancement Algorithm Based on Wavelet Transform

Speech Enhancement Algorithm Using Wiener Filtering Based on Improved Energy to Entropy Ratio

A Novel Speech Enhancement Algorithm Based on Data Field

Improved Weighted Multimodulus Blind Equalization Algorithm

Speech Enhancement Algorithm Based on Spectral Subtraction

A novel speech enhancement method based on wavelet packet energy in strong noise background

Incorporation of a modified temporal cepstrum smoothing in both signal-to-noise ratio and speech presence probability estimation for speech enhancement

A Speech Enhancement Algorithm Based on Computational Auditory Scene Analysis

Millimeter Wave Conduct Speech Enhancement Based on Auditory Masking Properties