Abstract:In this paper, we propose parameter generation methods using rich context models as yet another hybrid method combining Hidden Markov Model (HMM)-based speech synthesis and unit selection synthesis. Traditional HMM-based speech synthesis enables flexible modeling of acoustic features based on a statistical approach. However, the speech parameters tend to be excessively smoothed. To address this problem, several hybrid methods combining HMM-based speech synthesis and unit selection synthesis have been proposed. Although they significantly improve quality of synthetic speech, they usually lose flexibility of the original HMM-based speech synthesis. In the proposed methods, we use rich context models, which are statistical models that represent individual acoustic parameter segments. In training, the rich context models are reformulated as Gaussian Mixture Models (GMMs). In synthesis, initial speech parameters are generated from probability distributions over-fitted to individual segments, and the speech parameter sequence is iteratively generated from GMMs using a parameter generation method based on the maximum likelihood criterion. Since the basic framework of the proposed methods is still the same as the traditional framework, the capability of flexibly modeling acoustic features remains. The experimental results demonstrate: (1) the use of approximation with a single Gaussian component sequence yields better synthetic speech quality than the use of EM algorithm in the proposed parameter generation method, (2) the state-based model selection yields quality improvements at the same level as the frame-based model selection, (3) the use of the initial parameters generated from the over-fitted speech probability distributions is very effective to further improve speech quality, and (4) the proposed methods for spectral and $F_{0}$ components yields significant improvements in synthetic speech quality compared with the traditional HMM-based speech synthesis.

A state duration generation algorithm considering global variance for HMM-based speech synthesis

Global Variance Modeling on Frequency Domain Delta LSP for HMM-based Speech Synthesis

HMM based speech synthesis with Global Variance Training method

Global Variance Modeling on the Log Power Spectrum of LSPs for HMM-based Speech Synthesis

Voiced/unvoiced Decision Algorithm for HMM-based Speech Synthesis

Evaluation of parameter generation using high order dynamic features and long span windows for HMM based speech synthesis

Parameter Generation Methods With Rich Context Models for High-Quality and Flexible Text-To-Speech Synthesis

An unvoiced/voiced duration adjustment algorithm based on context features in mandarin TTS

Duration optimization of speaker adaptation in Mandarin TTS

Statistical Modification Based Post-Filtering Technique for HMM-based Speech Synthesis

Attention-based Recurrent Generator with Gaussian Tolerance for Statistical Parametric Speech Synthesis

State Duration-Based Segmental Probability Model for Chinese Speech

Minimum Kullback–Leibler Divergence Parameter Generation for HMM-Based Speech Synthesis

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

A Hierarchical Viterbi Algorithm For Mandarin Hybrid Speech Synthesis System

Improvement of hidden Markov model (HMM) for speech recognition

Improving HMM Based Speech Synthesis by Reducing Over-Smoothing Problems

A Novel Hmm-Based Tts System Using Both Continuous Hmms And Discrete Hmms

State Duration-Based Segmental Probability Model

A Novel HTS System Using both Continuous HMMs and Discrete HMMs

Median-Based Generation of Synthetic Speech Durations using a Non-Parametric Approach