Abstract:Pitch, as a sensation of the sound frequency, is a crucial attribute toward constructing a natural voice for communication. Producing intelligible sounds with normal pitches depend on substantive interdependencies among facial and neck muscles. Clarifying the interrelations between the pitches and the corresponding muscular activities would be helpful for evaluating the pitch-related phonating functions, which would play a significant role both in training pronunciation and in assessing dysphonia. In this study, the speech signals and the high-density surface electromyography (HD sEMG) signals were synchronously acquired when phonating [a:], [i:], and [ә:] vowels with increasing pitches, respectively. The HD sEMG energy maps were constructed based on the root mean square values to visualize spatiotemporal characteristics of facial and neck muscle activities. Normalized median frequency (nMF) and root-mean square (nRMS) were correspondingly extracted from the speech and sEMG recordings to quantitatively investigate the correlations between sound frequencies and myoelectric characteristics. The results showed that the frame-wise energy maps built from sEMG recordings presented that the muscle contraction strength increased monotonously across pitch-rising, with left-right symmetrical distribution for the face/neck. Furthermore, the nRMS increased at a similar rate to the nMF when there were rising pitches, and the two parameters had a significant correlation across different vowel tasks [(a:) (0.88 ± 0.04), (i:) (0.89 ± 0.04), and (ә:) (0.87 ± 0.05)]. These findings suggested the possibility of utilizing muscle contraction patterns as a reference for evaluating pitch-related phonation functions. The proposed method could open a new window for developing a clinical approach for assessing the muscular functions of dysphonia.

Integration of Three-Dimensional and Pressure Sensitive Palatography for Speech Production Study

The Improved Data Processing Method for Electronic Tongue Based on Multi-Ion Laps

Implementation of Electropalatography and Evaluation of the Rhotic “r” Sound

EPG2S: Speech Generation and Speech Enhancement based on Electropalatography and Audio Signals using Multimodal Learning

Tongue pressure recordings during speech using complete denture

Perceptual Evaluation and Acoustic Analysis of Pneumatic Artificial Larynx

Simultaneous 3D Surface Profile and Pressure Measurement Using Phase-Shift Profilometry and Pressure-Sensitive Paint.

Aero-tactile integration in speech perception

Method for Recognizing Pressing Position and Shear Force Using Active Acoustic Sensing on Gel Plates

Dynamic Measurement of Tongue Shape Using Ultrasonic System. Influence of Vertical Dimension of Occlusion on Tongue Shape.

PRESLA: An original device to measure the mechanical interaction between tongue and teeth or palate during speech production

Comparison of Parametrization Methods of Electroglottographic and Inverse Filtered Acoustic Speech Pressure Signals in Distinguishing Between Phonation Types

Real-time Ultrasound-enhanced Multimodal Imaging of Tongue using 3D Printable Stabilizer System: A Deep Learning Approach

Basic characteristics of tongue pressure and electromyography generated by articulation of a syllable using the posterior part of the tongue

MXene-based Pressure Sensor with Ultrahigh Sensitivity in a Small Pressure Range for Voiceless Speaking and Abnormal Writing Recognition

Acquiring and visualizing 3D/4D ultrasound recordings of tongue motion

Tongue Resting Pressure of the Tongue Anchorage Pad in Different Body Positions: A Pilot Study

Towards Evaluating Pitch-Related Phonation Function in Speech Communication Using High-Density Surface Electromyography

Pressure Distributions in Glottal Geometries With Multichannel Airflows

Measuring Voice Effects of Vibrato-Free and Ingressive Singing: A Study of Phonation Threshold Pressures

Speech animation using electromagnetic articulography as motion capture data