Abstract:Machine learning techniques have long been applied in many fields and have gained a lot of success. The purpose of learning processes is generally to obtain a set of parameters based on a given data set by minimizing a certain objective function which can explain the data set in a maximum likelihood or minimum estimation error sense. However, most of the learned parameters are highly data dependent and rarely reflect the true physical mechanism that is involved in the observation data. In order to obtain the inherent knowledge involved in the observed data, it is necessary to combine physical models with learning process rather than only fitting the observations with a black box model. To reveal underlying properties of human speech production, we proposed a learning process based on a physiological articulatory model and a coarticulation model, where both of the models are derived from human mechanisms. A two-layer learning framework was designed to learn the parameters concerned with physiological level using the physiological articulatory model and the parameters in the motor planning level using the coarticulation model. The learning process was carried out on an articulatory database of human speech production. The learned parameters were evaluated by numerical experiments and listening tests. The phonetic targets obtained in the planning stage provided an evidence for understanding the virtual targets of human speech production. As a result, the model based learning process reveals the inherent mechanism of the human speech via the learned parameters with certain physical meaning.

Decoding the Dancing of the Tongue: A Model-Based Learning Approach to Phonetic Targets in Coarticulation

Decoding the dancing of the tongue: A model-based learning approach to phonetic targets in coarticulationa)

Observation and Modeling of Lingual Coarticulation in the Planning Stage

A Model-Based Learning Process for Modeling Coarticulation of Human Speech

A Simulation Based Parameter Optimization for a Coarticulation Model.

Implement of Coarticulation in Physiological Articulatory Model

A simulation based parameter optimiza

Investigation and modeling of coarticulation in speech production

Simulating Articulatory Trajectories with Phonological Feature Interpolation

An articulatory model of standard Chinese using MRI and X-ray movie

Target-filtering model based articulatory movement prediction for articulatory control of HMM-based speech synthesis

Coding Speech through Vocal Tract Kinematics

Learning Model-Based F0 Production Through Goal-Directed Babbling

Towards a Quantitative Analysis of Coarticulation with a Phoneme-to-Articulatory Model

Novel Acoustic Modeling with Structured Hidden Dynamics for Speech Coarticulation and Reduction

Synthesizing 3D Trump: Predicting and Visualizing the Relationship Between Text, Speech, and Articulatory Movements.

Construction and control of a physiological articulatory model.

Speech synthesis of VCV sequence using a physiological articulatory model

Improvement of a Physiological Articulatory Model for Synthesis of Vowel Sequences

Speech synthesis using a physiological articulatory model with feature-based rules

Improvements of a Physiological Articulatory Model in Construction and Control Strategy