Abstract:Several studies have shown cross-modal associations between sounds and vision or gustation by asking participants to match pre-defined sound-symbolic words (SSWs), such as "bouba" or "kiki," with visual or gustatory materials. Here, we conducted an explorative study on cross-modal associations of tactile sensations using spontaneous production of Japanese SSWs and semantic ratings. The Japanese language was selected, because it has a large number of SSWs that can represent a wide range of tactile perceptual spaces with fine resolution, and it shows strong associations between sound and touch. In the experiment, we used 120 everyday materials to cover basic material categories that could be associated with fundamental dimensions of tactile perception. Upon contact with these materials, participants expressed their tactile sensations by using Japanese SSWs, and at the same time, evaluated the tactile sensations by semantic differential scales using adjective pairs. Thanks to the variety of testing materials, we were able to demonstrate the existence of systematic associations between sounds and tactile fundamental perceptual dimensions in a more detailed and comprehensive way than ever done so before. In particular, we found that for vowels, positive tactile ratings were associated with the back vowel (/u/), while negative ratings were associated with the front vowels (/i/ and /e/). The central vowels (/o/ and /a/) were mainly associated with rough, hard, and dry feelings. Consonants were categorized based on vocal features and articulation. The category of the voiced consonants (e.g., /dz/ and /g/) corresponded to feelings of roughness, while that of voiceless consonants (e.g., /ʦ/, and /s/) corresponded to feelings of smoothness. The categories of the bilabial plosive (/p/ and /b/) and voiced alveolar nasal (/n/) consonants were mainly related to soft, sticky and wet feelings, while that of voiceless alveolar affricate (/ʦ/) and voiceless velar plosive (/k/) consonants were related to hard, slippery and dry feelings.

Semantically Layered Structure of Tactile Textures

When Sandpaper Is 'Kiki' and Satin Is 'Bouba': an Exploration of the Associations Between Words, Emotional States, and the Tactile Attributes of Everyday Materials

Syntactical Organization of Statements with Chains of Tactile Adjectives in Polymodal Perception

Perceptual dimensions of tactile textures

Tactile Evaluation Feedback System for Multi-Layered Structure Inspired by Human Tactile Perception Mechanism

Texture Gradients and Perceptual Constancy under Haptic Exploration.

Tactile Adjective Understanding Using Structured Output-Associated Dictionary Learning

Bouba/Kiki in Touch: Associations Between Tactile Perceptual Qualities and Japanese Phonemes

Automatic Estimation of Multidimensional Ratings from a Single Sound-Symbolic Word and Word-Based Visualization of Tactile Perceptual Space

Tactile Aesthetics of Materials and Design

Sensory words may facilitate certain haptic exploratory procedures in facial cosmetics

Tactile Material Identification Using Semantics-Regularized Dictionary Learning

[Analyses of the sensory relevance of adjective pairs by the modality differential method]

Texture Design for Light Touch Perception

Crossmodal associations between naturally occurring tactile and sound textures

Haptic and Tactile Adjectives Are Consistently Mapped onto Color Space

Visualizing Individual Perceptual Differences Using Intuitive Word-Based Input

Affective Evaluation for Material Perception of Bead-Coated Resin Surfaces Using Visual and Tactile Sensations—Focusing on Kawaii

Texture perception through direct and indirect touch: an analysis of perceptual space for tactile textures in two modes of exploration

Using stepwise backward elimination to specify terms related to tactile sense for product design

Learning to Predict Perceptual Distributions of Haptic Adjectives