Abstract:Based on the existing research on sound symbolism and crossmodal correspondence, this study proposed an extended research on cross-modal correspondence between various sound attributes and color properties in a group of non-synesthetes. In Experiment 1, we assessed the associations between each property of sounds and colors. Twenty sounds with five auditory properties (pitch, roughness, sharpness, tempo and discontinuity), each varied in four levels, were used as the sound stimuli. Forty-nine colors with different hues, saturation and brightness were used to match to those sounds. Result revealed that besides pitch and tempo, roughness and sharpness also played roles in sound-color correspondence. Reaction times of sound-hue were a little longer than the reaction times of sound-lightness. In Experiment 2, a speeded target discrimination task was used to assess whether the associations between sound attributes and color properties could invoke natural cross-modal correspondence and improve participants’ cognitive efficiency in cognitive tasks. Several typical sound-color pairings were selected according to the results of Experiment 1. Participants were divided into two groups (congruent and incongruent). In each trial participants had to judge whether the presented color could appropriately be associated with the sound stimuli. Result revealed that participants responded more quickly and accurately in the congruent group than in the incongruent group. It was also found that there was no significant difference in reaction times and error rates between sound-hue and sound-lightness. The results of Experiment 1 and 2 indicate the existence of a robust crossmodal correspondence between multiple attributes of sound and color, which also has strong influence on cognitive tasks. The inconsistency of the reaction times between sound-hue and sound-lightness in Experiment 1 and 2 is probably owing to the difference in experimental protocol, which indicates that the complexity of experiment design may be an important factor in crossmodal correspondence phenomena.

Crossmodal associations between naturally occurring tactile and sound textures

The Cross‐modal Interaction Between Sound Frequency and Color Saturation on Consumer's Product Size Perception, Preference, and Purchase

When Sandpaper Is 'Kiki' and Satin Is 'Bouba': an Exploration of the Associations Between Words, Emotional States, and the Tactile Attributes of Everyday Materials

Cortical Oscillatory Dynamics of Tactile Selective Sensation - for a Novel Type of Somatosensory Brain-computer Interface

An Extended Research of Crossmodal Correspondence Between Color and Sound in Psychology and Cognitive Ergonomics

Perceptual dimensions of tactile textures

Auditory influence on stickiness perception: an fMRI study of multisensory integration

Crossmodal Correspondences in the Sounds of Chinese Instruments.

Bouba/Kiki in Touch: Associations Between Tactile Perceptual Qualities and Japanese Phonemes

Congruency effects between auditory and tactile motion: extending the phenomenon of cross-modal dynamic capture

Tactile estimation of hedonic and sensory properties during active touch: An electroencephalography study

Inducing Novel Sound–Taste Correspondences via an Associative Learning Task

Simple and complex crossmodal correspondences involving audition

Crossmodal Correspondence Between Tonal Hierarchy and Visual Brightness: Associating Syntactic Structure and Perceptual Dimensions Across Modalities

Effect of Vibrotactile Stimulation on Auditory Timbre Perception for Normal-Hearing Listeners and Cochlear-Implant Users

Cross-Modal Communication: Sound Frequency Influences Consumer Responses to Color Lightness

Reflections on Cross-Modal Correspondences: Current Understanding and Issues for Future Research

Haptic and Tactile Adjectives Are Consistently Mapped onto Color Space

Utilising natural cross-modal mappings for visual control of feature-based sound synthesis

Prefrontal Cortex And Somatosensory Cortex In Tactile Crossmodal Association: An Independent Component Analysis Of Erp Recordings

It Sounds Cool: Exploring Sonification of Mid-Air Haptic Textures Exploration on Texture Judgments, Body Perception, and Motor Behaviour