Abstract:This paper addresses the following two hypotheses: (i) vocal-tract area functions of Japanese vowels can be accurately represented by a linear combination of only a few principal components which, furthermore, are similar to those reported in the literature for different languages; and (ii) the principal components’ weights can be predicted and area functions thereby accurately estimated from acoustics by linear regression of cepstrum parameters. To test these hypotheses, synchronized acoustic and vocal-tract 3D MRI data were recorded from an adult male Japanese speaker for both sustained and dynamic vowel utterances. The first two principal components explained covariations in vocal-tract shape and length accounting for 94–97% of the total variance, and indeed provided a cross-linguistic validation of the two underlying components of vowel production emergent from the literature. Multiple linear regression models were then evaluated for their accuracy in reconstructing the area functions of the dynamic utterance by predicting the first two PC coefficients, using either carefully measured formants or cepstral coefficients defined in various frequency bands. The best formant-based regression model required all four formants, with a mean adjusted correlation of 0.93 and mean absolute errors of 0.187cm2 in area and 0.131cm in vocal-tract length. The best cepstrum-based regression model prescribed 24 cepstral coefficients defined in the frequency band 0–4kHz, with a mean adjusted correlation of 0.92 and mean absolute errors of 0.102cm2 in area and 0.082cm in vocal-tract length. These results suggest that vowel production features, properly constrained by PCA modeling, can be mapped with sufficient accuracy from easily measured cepstrum parameters. More work is required to reduce the dependence on MRI data, to extend the applicability of these methods to different voice qualities and different speakers, and to select a smaller subset of acoustic parameters for more robust, real-time inversion.

On the Evaluation of Inversion Mapping Performance in the Acoustic Domain

Speaker-Independent Acoustic-to-Articulatory Speech Inversion

Evaluation Of Linear Regression For Speaker Adaptation In Hmm-Based Articulatory Movements Estimation

Unsupervised Acoustic-to-Articulatory Inversion with Variable Vocal Tract Anatomy

Estimate Articulatory Mri Series From Acoustic Signal Using Deep Architecture

The Use of Articulatory Movement Data in Speech Synthesis Applications: an Overview — Application of Articulatory Movements Using Machine Learning Algorithms —

Kullback-Leibler Divergence Based Performace Evaluation of Geoacoustic Inverison Using Sources of Opportunity

Articulatory-WaveNet: Autoregressive Model For Acoustic-to-Articulatory Inversion

An Analysis of HMM-based Prediction of Articulatory Movements

DNN-based Acoustic-to-Articulatory Inversion using Ultrasound Tongue Imaging

A generalized smoothness criterion for acoustic-to-articulatory inversion

Speaker-Independent Acoustic-to-Articulatory Inversion through Multi-Channel Attention Discriminator

Combined Articulatory and Auditory Processing for Improved Speech Recognition

Study on a Joint Inversion Algorithm for Acoustic and Electromagnetic Data Based on Contrast Source Inversion Method and Cross-gradient Constraint

Unsupervised Inference of Physiologically Meaningful Articulatory Trajectories with VocalTractLab

Complete reconstruction of the tongue contour through acoustic to articulatory inversion using real-time MRI data

Principal components of vocal-tract area functions and inversion of vowels by linear regression of cepstrum coefficients

A deep recurrent approach for acoustic-to-articulatory inversion

Feature-Space Transform Tying in Unified Acoustic-Articulatory Modelling for Articulatory Control of HMM-Based Speech Synthesis.

Research on the Distal Supervised Learning Model of Speech Inversion.

Speaker-independent speech inversion for recovery of velopharyngeal port constriction degreea)