Abstract:Several studies have shown cross-modal associations between sounds and vision or gustation by asking participants to match pre-defined sound-symbolic words (SSWs), such as "bouba" or "kiki," with visual or gustatory materials. Here, we conducted an explorative study on cross-modal associations of tactile sensations using spontaneous production of Japanese SSWs and semantic ratings. The Japanese language was selected, because it has a large number of SSWs that can represent a wide range of tactile perceptual spaces with fine resolution, and it shows strong associations between sound and touch. In the experiment, we used 120 everyday materials to cover basic material categories that could be associated with fundamental dimensions of tactile perception. Upon contact with these materials, participants expressed their tactile sensations by using Japanese SSWs, and at the same time, evaluated the tactile sensations by semantic differential scales using adjective pairs. Thanks to the variety of testing materials, we were able to demonstrate the existence of systematic associations between sounds and tactile fundamental perceptual dimensions in a more detailed and comprehensive way than ever done so before. In particular, we found that for vowels, positive tactile ratings were associated with the back vowel (/u/), while negative ratings were associated with the front vowels (/i/ and /e/). The central vowels (/o/ and /a/) were mainly associated with rough, hard, and dry feelings. Consonants were categorized based on vocal features and articulation. The category of the voiced consonants (e.g., /dz/ and /g/) corresponded to feelings of roughness, while that of voiceless consonants (e.g., /ʦ/, and /s/) corresponded to feelings of smoothness. The categories of the bilabial plosive (/p/ and /b/) and voiced alveolar nasal (/n/) consonants were mainly related to soft, sticky and wet feelings, while that of voiceless alveolar affricate (/ʦ/) and voiceless velar plosive (/k/) consonants were related to hard, slippery and dry feelings.

Assessing sound symbolism: Investigating phonetic forms, visual shapes and letter fonts in an implicit bouba-kiki experimental paradigm

Symbouki: a meta-analysis on the emergence of sound symbolism in early language acquisition

What does Kiki look like? Cross-modal associations between speech sounds and visual shapes in vision-and-language models

Matching sounds to shapes: Evidence of the Bouba-Kiki effect in naive baby chicks

From the Bob/Kirk effect to the Benoit/Éric effect: Testing the mechanism of name sound symbolism in two languages

Stimulus Parameters Underlying Sound-Symbolic Mapping of Auditory Pseudowords to Visual Shapes

A social Bouba/Kiki effect: A bias for people whose names match their faces

Neural Basis of the Sound-Symbolic Crossmodal Correspondence Between Auditory Pseudowords and Visual Shapes

Phonetic underpinnings of sound symbolism across multiple domains of meaning

Sound symbolism shapes the English language: The maluma/takete effect in English nouns

Differential contributions of the spectro-temporal and vocal characteristics of auditory pseudowords to multiple sound-symbolic mappings

Bouba/Kiki in Touch: Associations Between Tactile Perceptual Qualities and Japanese Phonemes

Eye movements reveal persistent sensitivity to sound symbolism during word learning.

Guessing Meaning From Word Sounds of Unfamiliar Languages: A Cross-Cultural Sound Symbolism Study

Phonetic bases of sound symbolism: A review

Seeing Sounds, Hearing Shapes: a gamified study to evaluate sound-sketches

Effects of environmental sounds on the guessability of animated graphic symbols

Iconicity in the lab: a review of behavioral, developmental, and neuroimaging research into sound-symbolism

With Ears to See and Eyes to Hear: Sound Symbolism Experiments with Multimodal Large Language Models

Cross-sensory correspondences and symbolism in spoken and written language.

The Effects of Environmental Sound and Animation on the Naming Accuracy of Graphic Symbols