Abstract:The traditional vocoders have the advantages of high synthesis efficiency, strong interpretability, and speech editability, while the neural vocoders have the advantage of high synthesis quality. To combine the advantages of two vocoders, inspired by the traditional deterministic plus stochastic model, this paper proposes a novel neural vocoder named NeuralDPS which can retain high speech quality and acquire high synthesis efficiency and noise controllability. Firstly, this framework contains four modules: a deterministic source module, a stochastic source module, a neural V/UV decision module and a neural filter module. The input required by the vocoder is just the spectral parameter, which avoids the error caused by estimating additional parameters, such as F0. Secondly, to solve the problem that different frequency bands may have different proportions of deterministic components and stochastic components, a multiband excitation strategy is used to generate a more accurate excitation signal and reduce the neural filter's burden. Thirdly, a method to control noise components of speech is proposed. In this way, the signal-to-noise ratio (SNR) of speech can be adjusted easily. Objective and subjective experimental results show that our proposed NeuralDPS vocoder can obtain similar performance with the WaveNet and it generates waveforms at least 280 times faster than the WaveNet vocoder. It is also 28% faster than WaveGAN's synthesis efficiency on a single CPU core. We have also verified through experiments that this method can effectively control the noise components in the predicted speech and adjust the SNR of speech. Examples of generated speech can be found at <a class="link-external link-https" href="https://hairuo55.github.io/NeuralDPS" rel="external noopener nofollow">this https URL</a>.

Speaker-independent Training and Adaptation of Neural Vocoders

Online Speaker Adaptation for WaveNet-based Neural Vocoders

WaveNet Vocoder with Limited Training Data for Voice Conversion

Wasserstein GAN and Waveform Loss-based Acoustic Model Training for Multi-speaker Text-to-Speech Synthesis Systems Using a WaveNet Vocoder

Survey of Speaker Adaptation Methods in Speech Recognition

A Unified Speaker Adaptation Method for Speech Synthesis using Transcribed and Untranscribed Speech with Backpropagation

Hierarchical RNNs for Waveform-Level Speech Synthesis

Towards achieving robust universal neural vocoding

Towards Robust Neural Vocoding for Speech Generation: A Survey

A Synthetic Corpus Generation Method for Neural Vocoder Training

NeuralDPS: Neural Deterministic Plus Stochastic Model with Multiband Excitation for Noise-Controllable Waveform Generation

VNet: A GAN-based Multi-Tier Discriminator Network for Speech Synthesis Vocoders

Direct adaptation of hybrid DNN/HMM model for fast speaker adaptation in LVCSR based on speaker code

Frame Selection in SI-DNN Phonetic Space with WaveNet Vocoder for Voice Conversion Without Parallel Training Data

Speaker-independent neural formant synthesis

Voice Conversion towards Arbitrary Speakers With Limited Data.

Linear Networks Based Speaker Adaptation for Speech Synthesis

Speaker Adaptation with MAP Estimation and Weighted Neighbor Regression

Spoofed training data for speech spoofing countermeasure can be efficiently created using neural vocoders

Online Speaker Adaptation for LVCSR Based on Attention Mechanism

Deep mixing generation network self-adaption method and system