Abstract:This paper proposes ESTVocoder, a novel excitation-spectral-transformed neural vocoder within the framework of source-filter theory. The ESTVocoder transforms the amplitude and phase spectra of the excitation into the corresponding speech amplitude and phase spectra using a neural filter whose backbone is ConvNeXt v2 blocks. Finally, the speech waveform is reconstructed through the inverse short-time Fourier transform (ISTFT). The excitation is constructed based on the F0: for voiced segments, it contains full harmonic information, while for unvoiced segments, it is represented by noise. The excitation provides the filter with prior knowledge of the amplitude and phase patterns, expecting to reduce the modeling difficulty compared to conventional neural vocoders. To ensure the fidelity of the synthesized speech, an adversarial training strategy is applied to ESTVocoder with multi-scale and multi-resolution discriminators. Analysis-synthesis and text-to-speech experiments both confirm that our proposed ESTVocoder outperforms or is comparable to other baseline neural vocoders, e.g., HiFi-GAN, SiFi-GAN, and Vocos, in terms of synthesized speech quality, with a reasonable model complexity and generation speed. Additional analysis experiments also demonstrate that the introduced excitation effectively accelerates the model's convergence process, thanks to the speech spectral prior information contained in the excitation.

An Improved 2.4kb/s Mixed Excitation Linear Prediction Vocoder

Improvement of Voiced-Unvoiced Classification in Vocoders

Realtime robust speech communication based on iterative joint source-channel decoding and demodulation algorithm for MELP vocoder

Research on MBE Algorithm at Bit Rate 800 Bps-2.4 Kbps Vocoder

Fuzzy Unvoiced/voiced Decision-Making for Sub-Bands for SELP Vocoder

High Efficient Quantization of the Energy Parameter in 0.6 Kb/s Vocoders

Sinusoidal excitation LPC vocoder

The Statistic-Based Prediction of Excitation Spectral Parameters in Low Bit-rate Vocoder

A Low-Complexity 2400b/s Vocoder

DCT_M Model for Excitation Parameter in Low Bit Rate Vocoder

High Efficiency MSVQ for Prediction Linear Spectrum Frequency Parameters with Inter-Frame and Inter-Stage Prediction

Leaping Frame Detection and Processing with a 2.4 Kb/s SELP Vocoder

vec2wav 2.0: Advancing Voice Conversion via Discrete Token Vocoders

ESTVocoder: An Excitation-Spectral-Transformed Neural Vocoder Conditioned on Mel Spectrogram

A Speech Error Concealment Algorithm Based on Parameter Redundancy and Voiced/unvoiced Classification

A NEW DISTORTION MEASURE FOR PARAMETER QUANTIZATION BASED ON MELP Ye Li 1

An improved algorithm for pitch quantization in SELP vocoders

Channel Error Resilience Algorithm for Vocoder LSP Parameters

High-Quality Voice Conversion Using Spectrogram-Based Wavenet Vocoder

Research on real time low bit-rate speech coding

A Fractional Bit Allocation Algorithm Based on Mixed Excitation Linear Prediction