Abstract:In this paper, we propose a novel speech enhancement method based on dual-tree complex wavelet transforms (DTCWT) and nonnegative matrix factorization (NMF) that exploits the subband smooth ratio mask (ssRM) through a joint learning process. The discrete wavelet packet transform (DWPT) suffers the absence of shift invariance, due to downsampling after the filtering process, resulting in a reconstructed signal with significant noise. The redundant stationary wavelet transform (SWT) can solve this shift invariance problem. In this respect, we use efficient DTCWT with a shift invariance property and limited redundancy and calculate the ratio masks (RMs) between the clean training speech and noisy speech (i.e., training noise mixed with clean speech). We also compute RMs between the noise and noisy speech and then learn both RMs with their corresponding clean training clean speech and noise. The auto-regressive moving average (ARMA) filtering process is applied before NMF in previously generated matrices for smooth decomposition. An ssRM is proposed to exploit the advantage of the joint use of the standard ratio mask (sRM) and square root ratio mask (srRM). In short, the DTCWT produces a set of subband signals employing the time-domain signal. Subsequently, the framing scheme is applied to each subband signal to form matrices and calculates the RMs before concatenation with the previously generated matrices. The ARMA filter is implemented in the nonnegative matrix, which is formed by considering the absolute value. Through ssRM, speech components are detected using NMF in each newly formed matrix. Finally, the enhanced speech signal is obtained via the inverse DTCWT (IDTCWT). The performances are evaluated by considering an IEEE corpus, the GRID audio-visual corpus, and different types of noises. The proposed approach significantly improves objective speech quality and intelligibility and outperforms the conventional STFT-NMF, DWPT-NMF, and DNN-IRM methods.

A Block Cosine Transform and Its Application in Speech Recognition

Block-mode Discriminant Analysis and Its Application to Face and Antenna Signal Recognition.

Bionic Cepstral coefficients (BCC): A new auditory feature extraction to noise-robust speaker identification

Robust MFCCs Derived from Differentiated Power Spectrum

CBC-Based Synthetic Speech Detection

Modified Mel Filter Bank to Compute MFCC of Subsampled Speech

Recognition of noisy speech using dynamic spectral subband centroids

Multi-Band Maximum A Posteriori Multi-Transformation Algorithm Based On The Discriminative Combination

Speech recognition using Hilbert-Huang transform based features

Speaker Recognition Based on Robust Auditory Feature

A High-Performance Auditory Feature for Robust Speech Recognition

Design and implementation of speech recognition algorithm based on frequency range

A hybrid discriminant fuzzy DNN with enhanced modularity bat algorithm for speech recognition

New Features Based on the Cohen'S Class of Bilinear Time-Frequency Representations for Speech Recognition

Robust Speech Recognition by Selecting Mel-Filter Banks

A New Speech Feature Extracted by Wavelet Analysis & Mel-Frequancy Filtering

Modified MFCCs for Robust Speaker Recognition

Sub-band Based Additive Noise Removal for Robust Speech Recognition.

Voice Recognition Algorithms using Mel Frequency Cepstral Coefficient (MFCC) and Dynamic Time Warping (DTW) Techniques

Supervised Single Channel Speech Enhancement Based on Dual-Tree Complex Wavelet Transforms and Nonnegative Matrix Factorization Using the Joint Learning Process and Subband Smooth Ratio Mask

Improved Extraction Algorithm for MFCC Feature