Abstract:This paper presents a new spectral modeling method for statistical parametric speech synthesis. In the conventional methods, high-level spectral parameters, such as mel-cepstra or line spectral pairs, are adopted as the features for hidden Markov model (HMM)-based parametric speech synthesis. Our proposed method described in this paper improves the conventional method in two ways. First, distributions of low-level, un-transformed spectral envelopes (extracted by the STRAIGHT vocoder) are used as the parameters for synthesis. Second, instead of using single Gaussian distribution, we adopt the graphical models with multiple hidden variables, including restricted Boltzmann machines (RBM) and deep belief networks (DBN), to represent the distribution of the low-level spectral envelopes at each HMM state. At the synthesis time, the spectral envelopes are predicted from the RBM-HMMs or the DBN-HMMs of the input sentence following the maximum output probability parameter generation criterion with the constraints of the dynamic features. A Gaussian approximation is applied to the marginal distribution of the visible stochastic variables in the RBM or DBN at each HMM state in order to achieve a closed-form solution to the parameter generation problem. Our experimental results show that both RBM-HMM and DBN-HMM are able to generate spectral envelope parameter sequences better than the conventional Gaussian-HMM with superior generalization capabilities and that DBN-HMM and RBM-HMM perform similarly due possibly to the use of Gaussian approximation. As a result, our proposed method can significantly alleviate the over-smoothing effect and improve the naturalness of the conventional HMM-based speech synthesis system using mel-cepstra.

New speech synthesis algorithm based on MBE

Research on MBE Algorithm at Bit Rate 800 Bps-2.4 Kbps Vocoder

New synthesis method based on LMA vocal tract model

Using AMR-WB method to improve the results of speech synthesis

A New Chinese Text-to-speech System with High Naturalness

Research on analysis and optimization of MBE

End-to-end Code-switched TTS with Mix of Monolingual Recordings.

Acoustic statistical modeling based new generation speech synthesis technology

Speech Enhancement Based on Analysis–Synthesis Framework with Improved Parameter Domain Enhancement

Speech Enhancement Based On Analysis Synthesis Framework With Improved Pitch Estimation And Spectral Envelope Enhancement

High quality Chinese text-to-speech system - BEYOND

Modeling Spectral Envelopes Using Restricted Boltzmann Machines and Deep Belief Networks for Statistical Parametric Speech Synthesis

Voiced/unvoiced Decision Algorithm for HMM-based Speech Synthesis

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

Improved unit selection speech synthesis method utilizing subjective evaluation results on synthetic speech

Application of Speech Coding Algorithm Based on MBE in Secure Communication

A High Quality MBE-LPC-FE Speech Coder at 2.4 Kbps and 1.2 Kbps.

Restricted Boltzmann Machine Based Spectrum Modeling and Unit Selection Speech Synthesis Method

Phoneme Dependent Speaker Embedding And Model Factorization For Multi-Speaker Speech Synthesis And Adaptation

Multi-Stage Speech Bandwidth Extension with Flexible Sampling Rate Control

A Hierarchical Viterbi Algorithm For Mandarin Hybrid Speech Synthesis System