Abstract:In this paper, we propose a novel speech enhancement method based on dual-tree complex wavelet transforms (DTCWT) and nonnegative matrix factorization (NMF) that exploits the subband smooth ratio mask (ssRM) through a joint learning process. The discrete wavelet packet transform (DWPT) suffers the absence of shift invariance, due to downsampling after the filtering process, resulting in a reconstructed signal with significant noise. The redundant stationary wavelet transform (SWT) can solve this shift invariance problem. In this respect, we use efficient DTCWT with a shift invariance property and limited redundancy and calculate the ratio masks (RMs) between the clean training speech and noisy speech (i.e., training noise mixed with clean speech). We also compute RMs between the noise and noisy speech and then learn both RMs with their corresponding clean training clean speech and noise. The auto-regressive moving average (ARMA) filtering process is applied before NMF in previously generated matrices for smooth decomposition. An ssRM is proposed to exploit the advantage of the joint use of the standard ratio mask (sRM) and square root ratio mask (srRM). In short, the DTCWT produces a set of subband signals employing the time-domain signal. Subsequently, the framing scheme is applied to each subband signal to form matrices and calculates the RMs before concatenation with the previously generated matrices. The ARMA filter is implemented in the nonnegative matrix, which is formed by considering the absolute value. Through ssRM, speech components are detected using NMF in each newly formed matrix. Finally, the enhanced speech signal is obtained via the inverse DTCWT (IDTCWT). The performances are evaluated by considering an IEEE corpus, the GRID audio-visual corpus, and different types of noises. The proposed approach significantly improves objective speech quality and intelligibility and outperforms the conventional STFT-NMF, DWPT-NMF, and DNN-IRM methods.

Robust Speaker Modeling Based on Constrained Nonnegative Tensor Factorization

Robust Feature Extraction for Speaker Recognition Based on Constrained Nonnegative Tensor Factorization

Auditory Sparse Representation for Robust Speaker Recognition Based on Tensor Structure

Nonnegative Tensor PCA and Application to Speaker Recognition in Noise Environments

Robust Multifactor Speech Feature Extraction Based on Gabor Analysis

Multifactor Sparse Feature Extraction Using Convolutive Nonnegative Tucker Decomposition

Robust speech feature extraction based on Gabor filtering and tensor factorization

Non-negative Tensor Factorization for Speech Enhancement

Sparse Nonnegative Matrix Factorization Strategy for Cochlear Implants

Robust Speaker Identification Using An Auditory-Based Feature

Transductive Convolutive Nonnegative Matrix Factorization For Speech Separation

Neural Network Based Multi-Factor Aware Joint Training for Robust Speech Recognition.

An Auditory Neural Feature Extraction Method for Robust Speech Recognition.

An Auditory-Based Feature Extraction Algorithm for Robust Speaker Identification under Mismatched Conditions

Supervised Single Channel Speech Enhancement Based on Dual-Tree Complex Wavelet Transforms and Nonnegative Matrix Factorization Using the Joint Learning Process and Subband Smooth Ratio Mask

A cochlear neuron based robust feature for speaker recognition

Robust Feature Extraction Using Temporal Context Averaging for Speaker Identification in Diverse Acoustic Environments

Deep Factorization for Speech Signal

A Generalized Model for Robust Tensor Factorization With Noise Modeling by Mixture of Gaussians.

Time-frequency Network for Robust Speaker Recognition

Improved multitaper PNCC feature for robust speaker verification