Abstract:Variability has been one of the major challenges for both theoretical understanding and computer synthesis of speech prosody. In this paper we show that economical representation of variability is the key to effective modeling of prosody. Specifically, we report the development of PENTAtrainer-A trainable yet deterministic prosody synthesizer based on an articulatory functional view of speech. We show with testing results on Thai, Mandarin and English that it is possible to achieve high-accuracy predictive synthesis of fundamental frequency contours with very small sets of parameters obtained through stochastic learning from real speech data. The first key component of this system is syllable-synchronized sequential target approximation implemented as the qTA model, which is designed to simulate, for each tonal unit, a wide range of contextual variability with a single invariant target. The second key component is the automatic learning of function-specific targets through stochastic global optimization, guided by a layered pseudo-hierarchical functional annotation scheme, which requires the manual labeling of only the temporal domains of the functional units. The results in terms of synthesis accuracy demonstrate that effective modeling of the contextual variability is the key also to effective modeling of function-related variability. Additionally, we show that, being both theory-based and trainable (hence data-driven), computational systems like PENTAtrainer can serve as an effective modeling tool in basic research, with which the level of falsifiability in theory testing can be raised, and also a closer link between basic and applied research in speech science can be developed. (C) 2013 Elsevier B.V. All rights reserved.

HMM based speech synthesis with Global Variance Training method

Global Variance Modeling on Frequency Domain Delta LSP for HMM-based Speech Synthesis

Improving HMM Based Speech Synthesis by Reducing Over-Smoothing Problems

Global Variance Modeling on the Log Power Spectrum of LSPs for HMM-based Speech Synthesis

A state duration generation algorithm considering global variance for HMM-based speech synthesis

Improving voice quality of HMM-based speech synthesis using voice conversion method

Statistical Modification Based Post-Filtering Technique for HMM-based Speech Synthesis

A Novel HTS System Using both Continuous HMMs and Discrete HMMs

Amplitude Spectrum Based Excitation Model For Hmm-Based Speech Synthesis

Toward Invariant Functional Representations of Variable Surface Fundamental Frequency Contours: Synthesizing Speech Melody Via Model-Based Stochastic Learning

A Novel Hmm-Based Tts System Using Both Continuous Hmms And Discrete Hmms

Irrelevant Variability Normalization Based HMM Training Using VTS Approximation of an Explicit Model of Environmental Distortions.

Speech Synthesis Based on Gaussian Conditional Random Fields

Pitch-Scaled Spectrum Based Excitation Model for HMM-based Speech Synthesis

Training Universal Vocoders with Feature Smoothing-Based Augmentation Methods for High-Quality TTS Systems

Probablistic Modelling of F0 in Unvoiced Regions in HMM Based Speech Synthesis

Formant-Controlled HMM-Based Speech Synthesis.

A Hierarchical Viterbi Algorithm For Mandarin Hybrid Speech Synthesis System

Inverse Filtering Based Harmonic Plus Noise Excitation Model for HMM-Based Speech Synthesis

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

HAM-TTS: Hierarchical Acoustic Modeling for Token-Based Zero-Shot Text-to-Speech with Model and Data Scaling