Abstract:The traditional vocoders have the advantages of high synthesis efficiency, strong interpretability, and speech editability, while the neural vocoders have the advantage of high synthesis quality. To combine the advantages of two vocoders, inspired by the traditional deterministic plus stochastic model, this paper proposes a novel neural vocoder named NeuralDPS which can retain high speech quality and acquire high synthesis efficiency and noise controllability. Firstly, this framework contains four modules: a deterministic source module, a stochastic source module, a neural V/UV decision module and a neural filter module. The input required by the vocoder is just the spectral parameter, which avoids the error caused by estimating additional parameters, such as F0. Secondly, to solve the problem that different frequency bands may have different proportions of deterministic components and stochastic components, a multiband excitation strategy is used to generate a more accurate excitation signal and reduce the neural filter's burden. Thirdly, a method to control noise components of speech is proposed. In this way, the signal-to-noise ratio (SNR) of speech can be adjusted easily. Objective and subjective experimental results show that our proposed NeuralDPS vocoder can obtain similar performance with the WaveNet and it generates waveforms at least 280 times faster than the WaveNet vocoder. It is also 28% faster than WaveGAN's synthesis efficiency on a single CPU core. We have also verified through experiments that this method can effectively control the noise components in the predicted speech and adjust the SNR of speech. Examples of generated speech can be found at <a class="link-external link-https" href="https://hairuo55.github.io/NeuralDPS" rel="external noopener nofollow">this https URL</a>.

Neural Wavetable: a playable wavetable synthesizer using neural networks

Wavespace: A Highly Explorable Wavetable Generator

Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders

SynthNet: Learning to Synthesize Music End-to-End

Neural Drum Machine : An Interactive System for Real-time Synthesis of Drum Sounds

Hierarchical RNNs for Waveform-Level Speech Synthesis

DDSP-based Neural Waveform Synthesis of Polyphonic Guitar Performance from String-wise MIDI Input

GANSynth: Adversarial Neural Audio Synthesis

NAS-FM: Neural Architecture Search for Tunable and Interpretable Sound Synthesis based on Frequency Modulation

Wavehax: Aliasing-Free Neural Waveform Synthesis Based on 2D Convolution and Harmonic Prior for Reliable Complex Spectrogram Estimation

A Neural Vocoder with Hierarchical Generation of Amplitude and Phase Spectra for Statistical Parametric Speech Synthesis

SING: Symbol-to-Instrument Neural Generator

NoiseBandNet: Controllable Time-Varying Neural Synthesis of Sound Effects Using Filterbanks

Wavetable Synthesis Using CVAE for Timbre Control Based on Semantic Label

A Generative Model for Raw Audio Using Transformer Architectures

NeuralDPS: Neural Deterministic Plus Stochastic Model with Multiband Excitation for Noise-Controllable Waveform Generation

Neural source-filter-based waveform model for statistical parametric speech synthesis

Neural Homomorphic Vocoder.

Neural source-filter waveform models for statistical parametric speech synthesis

GlotNet—A Raw Waveform Model for the Glottal Excitation in Statistical Parametric Speech Synthesis

FloWaveNet : A Generative Flow for Raw Audio