Abstract:Using phonological speech vocoding, we propose a platform for exploring relations between phonology and speech processing, and in broader terms, for exploring relations between the abstract and physical structures of a speech signal. Our goal is to make a step towards bridging phonology and speech processing and to contribute to the program of Laboratory Phonology.We show three application examples for laboratory phonology: compositional phonological speech modelling, a comparison of phonological systems and an experimental phonological parametric text-to-speech (TTS) system. The featural representations of the following three phonological systems are considered in this work: (i) Government Phonology (GP), (ii) the Sound Pattern of English (SPE), and (iii) the extended SPE (eSPE). Comparing GP- and eSPE-based vocoded speech, we conclude that the latter achieves slightly better results than the former. However, GP – the most compact phonological speech representation – performs comparably to the systems with a higher number of phonological features. The parametric TTS based on phonological speech representation, and trained from an unlabelled audiobook in an unsupervised manner, achieves intelligibility of 85% of the state-of-the-art parametric speech synthesis.We envision that the presented approach paves the way for researchers in both fields to form meaningful hypotheses that are explicitly testable using the concepts developed and exemplified in this paper. On the one hand, laboratory phonologists might test the applied concepts of their theoretical models, and on the other hand, the speech processing community may utilize the concepts developed for the theoretical phonological models for improvements of the current state-of-the-art applications.

Coupling Phonology and Phonetics in a Constraint-Based Gestural Model

Decoding the dancing of the tongue: A model-based learning approach to phonetic targets in coarticulationa)

Coding Speech through Vocal Tract Kinematics

Feature-Space Transform Tying in Unified Acoustic-Articulatory Modelling for Articulatory Control of HMM-Based Speech Synthesis.

Multi-Syllable Phonotactic Modelling

Simulating Articulatory Trajectories with Phonological Feature Interpolation

Synthesizing Expressive Speech to Convey Focus using a Perturbation Model for Computer-Aided Pronunciation Training

On the Emergence of Phonological Knowledge and on Motor Planning and Motor Programming in a Developmental Model of Speech Production

Differentiable Generative Phonology

Coupling relations underlying the production of speech articulator movements and their invariance to speech rate

Advancements of phonetics in the 21st century: A critical appraisal of time and space in Articulatory Phonology

Integrating Articulatory Features into HMM-Based Parametric Speech Synthesis

Specifying Intonation from Context for Speech Synthesis

Speech vocoding for laboratory phonology

Articulatory Control of HMM-based Parametric Speech Synthesis Driven by Phonetic Knowledge

EMPHASIS: An Emotional Phoneme-based Acoustic Model for Speech Synthesis System

Sound-Stream II: Towards Real-Time Gesture Controlled Articulatory Sound Synthesis

Cracking Prosody in Articulatory Phonology

A phonetic framework for the cross-linguistic analysis of cleft palate speech

Diffusion-Based Co-Speech Gesture Generation Using Joint Text and Audio Representation

Unified speech and gesture synthesis using flow matching