Abstract:Acoustic features play an important role in improving the quality of the synthesised speech. Currently, the Mel spectrogram is a widely employed acoustic feature in most acoustic models. However, due to the fine-grained loss caused by its Fourier transform process, the clarity of speech synthesised by Mel spectrogram is compromised in mutant signals. In order to obtain a more detailed Mel spectrogram, we propose a Mel spectrogram enhancement paradigm based on the continuous wavelet transform (CWT). This paradigm introduces an additional task: a more detailed wavelet spectrogram, which like the post-processing network takes as input the Mel spectrogram output by the decoder. We choose Tacotron2 and Fastspeech2 for experimental validation in order to test autoregressive (AR) and non-autoregressive (NAR) speech systems, respectively. The experimental results demonstrate that the speech synthesised using the model with the Mel spectrogram enhancement paradigm exhibits higher MOS, with an improvement of 0.14 and 0.09 compared to the baseline model, respectively. These findings provide some validation for the universality of the enhancement paradigm, as they demonstrate the success of the paradigm in different architectures.

Perceptually Weighted Mel-Cepstrum Analysis of Speech Based on Psychoacoustic Model

Weighted mel-cepstrum for speech analysis

Simplified Deformation Compensation for Emotional Speaker Recognition

Mel-Cepstrum Integrated with Pitch and Information of Voiced/Unvoiced

Cepstral Smoothing of Spectral Masks for Acoustic Vector-Sensor Based Convolutive Speech Separation

New algorithm of perceptual weighting filter used in CELP wideband speech codec.

Speech Enhancement Using Non-Negative Spectrogram Models With Mel-Generalized Cepstral Regularization

A Mel Spectrogram Enhancement Paradigm Based on CWT in Speech Synthesis

Plug-and-Play WPE Guided by Deep Spectrum Estimation for Speech Dereverberation

Robust Analysis And Weighting On Mfcc Components For Speech Recognition And Speaker Identification

Perturbation analysis of mel-frequency cepstrum coefficients

Noise reduction using wavelet thresholding of multitaper estimators and geometric approach to spectral subtraction for speech coding strategy

A Weighted Cepstral Distance Measure for Objective Quality Evaluation of Mandarin

Modified MFCCs for Robust Speaker Recognition

An Improved MELP Speech Coder

Speech Enhancement Based On Analysis Synthesis Framework With Improved Pitch Estimation And Spectral Envelope Enhancement

The Application of Perceptual Weighting on Millimeter Wave Conducted Speech Enhancement

Recognition of noisy speech using dynamic spectral subband centroids

Millimeter Wave Conduct Speech Enhancement Based on Auditory Masking Properties

Noise-robustness of speaker verification based on the perceptual log area ratio

Objective assessment of speech quality by combining Bark- and Mel-scale frequency