Abstract:Several studies have shown cross-modal associations between sounds and vision or gustation by asking participants to match pre-defined sound-symbolic words (SSWs), such as "bouba" or "kiki," with visual or gustatory materials. Here, we conducted an explorative study on cross-modal associations of tactile sensations using spontaneous production of Japanese SSWs and semantic ratings. The Japanese language was selected, because it has a large number of SSWs that can represent a wide range of tactile perceptual spaces with fine resolution, and it shows strong associations between sound and touch. In the experiment, we used 120 everyday materials to cover basic material categories that could be associated with fundamental dimensions of tactile perception. Upon contact with these materials, participants expressed their tactile sensations by using Japanese SSWs, and at the same time, evaluated the tactile sensations by semantic differential scales using adjective pairs. Thanks to the variety of testing materials, we were able to demonstrate the existence of systematic associations between sounds and tactile fundamental perceptual dimensions in a more detailed and comprehensive way than ever done so before. In particular, we found that for vowels, positive tactile ratings were associated with the back vowel (/u/), while negative ratings were associated with the front vowels (/i/ and /e/). The central vowels (/o/ and /a/) were mainly associated with rough, hard, and dry feelings. Consonants were categorized based on vocal features and articulation. The category of the voiced consonants (e.g., /dz/ and /g/) corresponded to feelings of roughness, while that of voiceless consonants (e.g., /ʦ/, and /s/) corresponded to feelings of smoothness. The categories of the bilabial plosive (/p/ and /b/) and voiced alveolar nasal (/n/) consonants were mainly related to soft, sticky and wet feelings, while that of voiceless alveolar affricate (/ʦ/) and voiceless velar plosive (/k/) consonants were related to hard, slippery and dry feelings.

Inferential statistics for monitoring and fault forecasting of PV plants

Automatic Estimation of Multidimensional Ratings from a Single Sound-Symbolic Word and Word-Based Visualization of Tactile Perceptual Space

Unveiling interactions of spatial-temporal information in tactile motion perception

Texture perception through direct and indirect touch: an analysis of perceptual space for tactile textures in two modes of exploration

Measuring the spatial Acuity of vibrotactile Stimuli: A new Approach to determine universal and individual Thresholds

Exploring the Sensory Spaces of English Perceptual Verbs in Natural Language Data

VisibleSound: Perceiving Environmental Sound with 4D Form

Cross-Modal Sensory Integration of Visual-Tactile Motion Information: Instrument Design and Human Psychophysics

Bouba/Kiki in Touch: Associations Between Tactile Perceptual Qualities and Japanese Phonemes

A behavioral approach to shared mapping of peripersonal space between oneself and others

Learning to Predict Perceptual Distributions of Haptic Adjectives

Perceptual Dimensions of Physical Properties of Handheld Objects Induced by Impedance Changes

Tactile Evaluation Feedback System for Multi-Layered Structure Inspired by Human Tactile Perception Mechanism

Let's Get Vysical: Perceptual Accuracy In Visual and Tactile Encodings

An empirical study of computing with words approaches for multi-person and single-person systems

Soft or Stiff? Stroop Tasks in Visuo-Tactile Tapping Interactions

Deciphering Contact Interactions and Exploration Strategies Underlying Tactile Perception of Material Softness

The Effects of Tactile Feedback on the Affective Evaluation of Switch Sounds

Costs of venom production in the common death adder (Acanthophis antarcticus).

Perceptual dimensions of tactile textures

An Evaluation Method for Hand-held Tactile Emotional Design