Abstract:Prosody is an essential aspect of speech, as it carries both lexical and non-lexical information. A conventional approach for studying speech prosody is to collect and analyze F0 data based on certain hypotheses and then develop a theory based on the observation as the final conclusion of the study. This process is however far from complete, as the developed theory has not been actually tested for its ability to predict actual acoustic data. This paper presents PENTATrainer2, a prosody modeling tool based on the parallel encoding and target approximation framework. PENTATrainer2 can facilitate prosody studies in testing hypotheses and theories against speech data by using an automatic analysis-by-synthesis and stochastic learning algorithm. Users can flexibly design the annotation scheme based on their own hypotheses and determine whether the hypothesized categories can lead to accurate synthetic F0 contours. PENTATrainer2 consists of three main components: multi-layer annotation, target approximation, and stochastic optimization. First, acoustic data are annotated in parallel layers, each of which corresponds to a functional category that may affect F0 contours. These layers are then compiled into unique functional combinations. The combinations represent underlying invariant representations of communicative functions and their interaction with each other. Target approximation parameters of each combination are then learned through analysis-by-synthesis and stochastic optimization. Pilot tests of PENTATrainer 2 have been conducted on Thai, Mandarin and English. The results demonstrate not only high accuracy of the synthesized F0 contours but also distinctive contrasts in the distribution of pitch target parameters. This indicates the effectiveness of PENTATrainer2 in modeling speech prosody.

Improvement of Probabilistic Acoustic Tube model for speech decomposition

Incorporating AM-FM Effect in Voiced Speech for Probabilistic Acoustic Tube Model

Probabilistic Acoustic Tube: a Probabilistic Generative Model of Speech for Speech Analysis/synthesis

Use Of Particle Filtering And Mcmc For Inference In Probabilistic Acoustic Tube Model

PENTATrainer2: A Hypothesis-Driven Prosody Modeling Tool

A New Acoustic Modeling of Inter-Syllable Context-Dependent Units for Putonghua Continuous Speech Recognition

Phonetic-assisted Multi-Target Units Modeling for Improving Conformer-Transducer ASR system

A New Combined Model of Statics-Dynamics of Speech.

Partial-tied-mixture Auxiliary Chain Models for Speech Recognition Based on Dynamic Bayesian Networks

Feature-Space Transform Tying in Unified Acoustic-Articulatory Modelling for Articulatory Control of HMM-Based Speech Synthesis.

Acoustic statistical modeling based new generation speech synthesis technology

Progressive Joint Modeling in Unsupervised Single-Channel Overlapped Speech Recognition.

Acoustic Modeling Based On Chinese Phonetics Knowledge

Integrating Articulatory Features into HMM-Based Parametric Speech Synthesis

Pan: Phoneme-Aware Network For Monaural Speech Enhancement

Double Articulation Analyzer with Prosody for Unsupervised Word and Phoneme Discovery

Improving Generalization of Speech Separation in Real-World Scenarios: Strategies in Simulation, Optimization, and Evaluation

Acoustic Statistical Modeling Based Speech Synthesis Technologies

Modeling speech melody as communicative functions with PENTAtrainer2

Pitch-scaled Analysis Based Residual Reconstruction for Speech Analysis and Synthesis

Bayesian estimation of dissipation and sound speed in tube measurements using a transfer-function model