Abstract:BACKGROUND AND OBJECTIVES: The characterization of the vocal tract geometry during speech interests various research topics, including speech production modeling, motor control analysis, and speech therapy design. Real-time MRI is a reliable and non-invasive tool for this purpose. In most cases, it is necessary to know the contours of the individual articulators from the glottis to the lips. Several techniques have been proposed for segmenting vocal tract articulators, but most are limited to specific applications. Moreover, they often do not provide individualized contours for all soft-tissue articulators in a multi-speaker configuration.METHODS: A Mask R-CNN network was trained to detect and segment the vocal tract articulator contours in two real-time MRI (RT-MRI) datasets with speech recordings of multiple speakers. Two post-processing algorithms were then proposed to convert the network's outputs into geometrical curves. Nine articulators were considered: the two lips, tongue, soft palate, pharynx, arytenoid cartilage, epiglottis, thyroid cartilage, and vocal folds. A leave-one-out cross-validation protocol was used to evaluate inter-speaker generalization. The evaluation metrics were the point-to-closest-point distance and the Jaccard index (for articulators annotated as closed contours).RESULTS: The proposed method accurately segmented the vocal tract articulators, with an average root mean square point-to-closest-point distance of less than 2.2mm for all the articulators in the leave-one-out cross-validation setting. The minimum P2CP<sub>RMS</sub> was 0.91mm for the upper lip, and the maximum was 2.18mm for the tongue. The Jaccard indices for the thyroid cartilage and vocal folds were 0.60 and 0.61, respectively. Additionally, the method adapted to a new subject with only ten annotated samples.CONCLUSIONS: Our research introduced a method for individually segmenting nine non-rigid vocal tract articulators in real-time MRI movies. The software is openly available as an installable package to the speech community. It is designed to develop speech applications and clinical and non-clinical research in fields that require vocal tract geometry, such as speech, singing, and human beatboxing.

Measurement of Cricothyroid Articulation Using High-Resolution MRI and 3d Pattern Matching.

Assessment of velopharyngeal function with dual-planar high-resolution real-time spiral dynamic MRI.

Numerical Investigation of the Influence of Thyroarytenoid and Cricothyroid Muscle Contraction on the Geometry and Biomechanical Properties of the Vocal Folds

Interaction Between the Thyroarytenoid and Lateral Cricoarytenoid Muscles in the Control of Vocal Fold Adduction and Eigenfrequencies

Synchronous 3D Imaging of the Medial and Superior Vocal Fold Surface in an excised human Hemilarynx

A new method of reconstructing the human laryngeal architecture using micro-MRI.

The Influence of Thyroarytenoid and Cricothyroid Muscle Activation on Vocal Fold Stiffness and Eigenfrequencies

A Study of Mandarin Chinese Using X-Ray and MRI

Automatic segmentation of vocal tract articulators in real-time magnetic resonance imaging

Laryngeal Muscular Control of Vocal Fold Posturing: Numerical Modeling and Experimental Validation.

Three-Dimensional Analysis of Vocal Fold Oscillations: Correlating Superior and Medial Surface Dynamics Using Ex Vivo Human Hemilarynges

Estimation Of Vocal Tract Area Function For Mandarin Vowel Sequences Using Mri

Measurement of acoustic and anatomic changes in oral and maxillofacial surgery patients

4D magnetic resonance imaging atlas construction using temporally aligned audio waveforms in speech

Application of Machine Learning to Ultrasonography in Identifying Anatomical Landmarks for Cricothyroidotomy Among Female Adults: A Multi-center Prospective Observational Study

Investigation of the Position and Angle of the Vocal Fold Projected onto the Thyroid Cartilage

Enhancing linguistic research through 2-mm isotropic 3D dynamic speech MRI optimized by sparse temporal sampling and low-rank reconstruction

[Antinuclear antibodies detected in autoimmune diseases].

Quantifying Articulatory Working Space in Individuals Surgically Treated for Oral Cancer With Electromagnetic Articulography

An Integrated Experimental-Computational Study of Vocal Fold Vibration in Type I Thyroplasty

Eccentric movements of temporomandibular joint and upper airway volume: Three-dimensional segmentation using cone beam computed tomography