Abstract:Several studies have shown cross-modal associations between sounds and vision or gustation by asking participants to match pre-defined sound-symbolic words (SSWs), such as "bouba" or "kiki," with visual or gustatory materials. Here, we conducted an explorative study on cross-modal associations of tactile sensations using spontaneous production of Japanese SSWs and semantic ratings. The Japanese language was selected, because it has a large number of SSWs that can represent a wide range of tactile perceptual spaces with fine resolution, and it shows strong associations between sound and touch. In the experiment, we used 120 everyday materials to cover basic material categories that could be associated with fundamental dimensions of tactile perception. Upon contact with these materials, participants expressed their tactile sensations by using Japanese SSWs, and at the same time, evaluated the tactile sensations by semantic differential scales using adjective pairs. Thanks to the variety of testing materials, we were able to demonstrate the existence of systematic associations between sounds and tactile fundamental perceptual dimensions in a more detailed and comprehensive way than ever done so before. In particular, we found that for vowels, positive tactile ratings were associated with the back vowel (/u/), while negative ratings were associated with the front vowels (/i/ and /e/). The central vowels (/o/ and /a/) were mainly associated with rough, hard, and dry feelings. Consonants were categorized based on vocal features and articulation. The category of the voiced consonants (e.g., /dz/ and /g/) corresponded to feelings of roughness, while that of voiceless consonants (e.g., /ʦ/, and /s/) corresponded to feelings of smoothness. The categories of the bilabial plosive (/p/ and /b/) and voiced alveolar nasal (/n/) consonants were mainly related to soft, sticky and wet feelings, while that of voiceless alveolar affricate (/ʦ/) and voiceless velar plosive (/k/) consonants were related to hard, slippery and dry feelings.

A social Bouba/Kiki effect: A bias for people whose names match their faces

Assessing sound symbolism: Investigating phonetic forms, visual shapes and letter fonts in an implicit bouba-kiki experimental paradigm

Social Judgments from Faces Are Universal

What does Kiki look like? Cross-modal associations between speech sounds and visual shapes in vision-and-language models

From the Bob/Kirk effect to the Benoit/Éric effect: Testing the mechanism of name sound symbolism in two languages

Matching sounds to shapes: Evidence of the Bouba-Kiki effect in naive baby chicks

The many faces of compensation: The similarities and differences between social and facial models of perception

Differentiation in social perception: Why later-encountered individuals are described more negatively.

Can names shape facial appearance?

The Social Name-Letter Effect on Online Social Networks

Altering Balance Perception Through the Agent’s Expression: Happy Face Suppresses the Inward Bias.

The Sound Symbolism of Names

Symbouki: a meta-analysis on the emergence of sound symbolism in early language acquisition

Visual Attention, Bias, and Social Dispositions Toward People With Facial Anomalies: A Prospective Study With Eye-Tracking Technology

Bouba/Kiki in Touch: Associations Between Tactile Perceptual Qualities and Japanese Phonemes

Facial misfits accelerate stereotype-based associative learning

Misremembering emotion: Inductive category effects for complex emotional stimuli

Closing a conceptual gap in race perception research: A functional integration of the other-race face recognition and "who said what?" paradigms.

Attractiveness vs. Partisan stereotypes

Intergroup processes and the happy face advantage: How social categories influence emotion categorization.

Red shape, blue shape: political ideology influences the social perception of body shape