Abstract:In this research work we investigate a new articulatory-phonetic representation, called the gestural score, as a model of human speech production and perception. This dissertation discusses three types of analyses which have been used to produce gestural scores for various consonant-vowel-consonant syllables. First, we describe an algorithm which nonlinearly transforms the recorded positional values of four pellets placed on the tongue during articulation into variables in a new Cartesian space, in which the new x-and y-values represent the distance of the pellets going back along the opposing vocal tract wall and the distance perpendicular to the tract wall. Second, the transformed articulatory data serve as input for a principal components analysis of four tongue pellets. The objectives of this analysis are twofold: 1) to examine the eeectiveness of the coordinate transformation, and 2) to study the constriction features of vowels. Third, a computational model which performs spatio-temporal mapping from articulatory data to the gestural score representation 1 2 is examined. The computational model uses temporal decomposition to approximate multi-channel trajectories and yield a set of target functions and vectors. Temporal decomposition constructs multiple-channel trajectories from data-derived target functions using a form of adaptive Gauss-Seidel iteration. The resultant target functions, in conjunction with the weights for each basis function, are then used to derive the articulatory-phonetic representation { gestural scores for the CVC syllables embedded in the frame sentences. The voicing information is derived from the simultaneously recorded electroglottograph data. This method is applied to the task of estimating the gestural score for various CVC syllables in a stimulus set. To evaluate the adequacy of the derived gestural scores two evaluations were performed: a perception test, and a classiication test using an automatic recognizer based on a neural network model. High recognition rates from both the perceptual experiments and the automatic recognizers support the hypothesis that suucient information is available in the resultant gestural scores to allow accurate identiication of the phonetic elements. Acknowledgments My sincere thanks go to my advisers, Stanley Ahalt and Ashok Krishnamurthy, whose expertise in signal processing and neural networks and teaching ability have given me a solid foundation. I also wish to thank my other committee member, Professor Mary Beckman, who took interest in this work and provided many helpful comments. Thanks also go to Sookhyang Lee, Kenneth DeJong, and Kevin Cohen for their helpful contributions to this work. I gratefully acknowledge grant support from NSF …

Implementation of Electropalatography and Evaluation of the Rhotic “r” Sound

Artificial Intelligence-Assisted Speech Therapy for /ɹ/: A Single-Case Experimental Study

Integration of Three-Dimensional and Pressure Sensitive Palatography for Speech Production Study

Gradient speech change during intervention for school-aged children and adults with cleft palate ± lip

EPG2S: Speech Generation and Speech Enhancement based on Electropalatography and Audio Signals using Multimodal Learning

Classifying Rhoticity of /r/ in Speech Sound Disorder using Age-and-Sex Normalized Formants

An Articulatory Analysis of American English Rhotics in Children With and Without a History of Residual Speech Sound Disorder

Prospective Validation of Motor-Based Intervention with Automated Mispronunciation Detection of Rhotics in Residual Speech Sound Disorders

Acoustic-to-Articulatory Speech Inversion Features for Mispronunciation Detection of /r/ in Child Speech Sound Disorders

Design and evaluation of an electrolarynx with tonal control function for Mandarin.

An Algorithm for Deriving an Articulatory-Phonetic Representation

An Empirical Study on Reading Aloud and Learning English by the Use of the Reading Assistant SRS

Exploiting ultrasound tongue imaging for the automatic detection of speech articulation errors

The impact of automatic speech recognition technology on second language pronunciation and speaking skills of EFL learners: a mixed methods investigation

English Pronunciation by Korean EFL Learners on Hilokal Language Educational Application

Perceptual Evaluation of Pronunciation Quality for Computer Assisted Language Learning

Mongolian Phonetic Research Based on EPG

Analysis of and feedback on phonetic features in pronunciation training with a virtual teacher

Transparent pronunciation scoring using articulatorily weighted phoneme edit distance

Evaluation of a Method for Vowel-Specific Voice Source Control of an Electrolarynx Using Visual Information

Real-Time Interactive Visualization Aiding Pronunciation of English as a Second Language