Abstract:Participants tend to produce a higher or lower vocal pitch in response to upward or downward visual motion, suggesting a pitch–motion correspondence between the visual and speech production processes. However, previous studies were contaminated by factors such as the meaning of vocalized words and the intrinsic pitch or tongue movements associated with the vowels. To address these issues, we examined the pitch–motion correspondence between simple visual motion and pitched speech production. Participants were required to produce a high- or low-pitched meaningless single vowel [a] in response to the upward or downward direction of a visual motion stimulus. Using a single vowel, we eliminated the artifacts related to the meaning, intrinsic pitch, and tongue movements of multiple vocalized vowels. The results revealed that vocal responses were faster when the pitch corresponded to the visual motion (consistent condition) than when it did not (inconsistent condition). This result indicates that the pitch–motion correspondence in speech production does not depend on the stimulus meaning, intrinsic pitch, or tongue movement of the vocalized words. In other words, the present study suggests that the pitch–motion correspondence can be explained more parsimoniously as an association between simple sensory (visual motion) and motoric (vocal pitch) features. Additionally, acoustic analysis revealed that speech production aligned with visual motion exhibited lower stress, greater confidence, and higher vocal fluency. Participants tend to produce a higher or lower vocal pitch in response to upward or downward visual motion, suggesting a pitch–motion correspondence between the visual and speech production processes. However, previous studies were contaminated by factors such as the meaning of vocalized words and the intrinsic pitch or tongue movements associated with the vowels. To address these issues, we examined the pitch–motion correspondence between simple visual motion and pitched speech production. Participants were required to produce a high- or low-pitched meaningless single vowel [a] in response to the upward or downward direction of a visual motion stimulus. Using a single vowel, we eliminated the artifacts related to the meaning, intrinsic pitch, and tongue movements of multiple vocalized vowels. The results revealed that vocal responses were faster when the pitch corresponded to the visual motion (consistent condition) than when it did not (inconsistent condition). This result indicates that the pitch–motion correspondence in speech production does not depend on the stimulus meaning, intrinsic pitch, or tongue movement of the vocalized words. In other words, the present study suggests that the pitch–motion correspondence can be explained more parsimoniously as an association between simple sensory (visual motion) and motoric (vocal pitch) features. Additionally, acoustic analysis revealed that speech production aligned with visual motion exhibited lower stress, greater confidence, and higher vocal fluency.

Sentences used in the speech-to-song illusion: Comparisons of acoustic vowel space

Speech-to-song transformation in perception and production

A Rational Analysis of the Speech-to-Song Illusion

Beyond musical training: Individual influences on the perception of the speech-to-song illusion

Illusions in speech sound and voice perception

Exploring the role of singing, semantics, and amusia screening in speech-in-noise perception in musicians and non-musicians

EXPRESS: Cross-Linguistic Effects of the Speech-to-Song Illusion in Speakers of Bangla and English

Perceptual Contributions of Vowels and Consonant-Vowel Transitions in Simulated Electric-Acoustic Hearing

Reorganization of the auditory-perceptual space across the human vocal range

A phrase in a loop: A rethink of verbatim repetition in the speech-to-song illusion and a new approach to the study of involuntary auditory imagery

Mental Operations in Rhythm: Motor-to-sensory Transformation Mediates Imagined Singing.

The Sounds of Sentences: Differentiating the Influence of Physical Sound, Sound Imagery, and Linguistically Implied Sounds on Physical Sound Processing

Increased vowel contrast and intelligibility in connected speech induced by sensorimotor adaptation

Intuitive visualizations of pitch and loudness in speech

Syllable Inference as a Mechanism for Spoken Language Understanding

Neural Mechanisms Underlying Cross-Modal Phonetic Encoding

Gender Perception of Speech: Dependence on Fundamental Frequency, Implied Vocal Tract Length, and Source Spectral Tilt

Visual Upward/Downward Motion Elicits Fast and Fluent High-/Low-Pitched Speech Production

Auditory enhancement and spectral contrast effects in speech perception

Humans can use positive and negative spectrotemporal correlations to detect rising and falling pitch

Perception Of Vowel Duration