Abstract:Based on the existing research on sound symbolism and crossmodal correspondence, this study proposed an extended research on cross-modal correspondence between various sound attributes and color properties in a group of non-synesthetes. In Experiment 1, we assessed the associations between each property of sounds and colors. Twenty sounds with five auditory properties (pitch, roughness, sharpness, tempo and discontinuity), each varied in four levels, were used as the sound stimuli. Forty-nine colors with different hues, saturation and brightness were used to match to those sounds. Result revealed that besides pitch and tempo, roughness and sharpness also played roles in sound-color correspondence. Reaction times of sound-hue were a little longer than the reaction times of sound-lightness. In Experiment 2, a speeded target discrimination task was used to assess whether the associations between sound attributes and color properties could invoke natural cross-modal correspondence and improve participants’ cognitive efficiency in cognitive tasks. Several typical sound-color pairings were selected according to the results of Experiment 1. Participants were divided into two groups (congruent and incongruent). In each trial participants had to judge whether the presented color could appropriately be associated with the sound stimuli. Result revealed that participants responded more quickly and accurately in the congruent group than in the incongruent group. It was also found that there was no significant difference in reaction times and error rates between sound-hue and sound-lightness. The results of Experiment 1 and 2 indicate the existence of a robust crossmodal correspondence between multiple attributes of sound and color, which also has strong influence on cognitive tasks. The inconsistency of the reaction times between sound-hue and sound-lightness in Experiment 1 and 2 is probably owing to the difference in experimental protocol, which indicates that the complexity of experiment design may be an important factor in crossmodal correspondence phenomena.

Cross-Modal Communication: Sound Frequency Influences Consumer Responses to Color Lightness

The Cross‐modal Interaction Between Sound Frequency and Color Saturation on Consumer's Product Size Perception, Preference, and Purchase

Asymmetrical Cross-Modal Influence on Neural Encoding of Auditory and Visual Features in Natural Scenes.

Does music really work? The two-stage audiovisual cross-modal correspondence effect on consumers’ shopping behavior

An Extended Research of Crossmodal Correspondence Between Color and Sound in Psychology and Cognitive Ergonomics

Congruency of color-sound crossmodal correspondence interacts with color and sound discrimination depending on color category

Influence of the Crossmodal Congruency Between Color and Flavor on Product Evaluations: Evidence from Behavioral and Oscillatory Brain Responses

Crossmodal Congruency Between Background Music and the Online Store Environment: The Moderating Role of Shopping Goals

Cross-modal Orienting of Visual Attention.

Colour Association with Music Is Mediated by Emotion: Evidence from an Experiment Using a CIE Lab Interface and Interviews

Crossmodal Modulation As a Basis for Visual Enhancement of Auditory Performance

Olfactory-colour crossmodal correspondences in art, science, and design

Crossmodal associations between naturally occurring tactile and sound textures

Music and Color Synaesthesia with Visual Saliency Information

Crossmodal semantic congruence guides spontaneous orienting in real-life scenes

Synaesthetic correspondence between auditory clips and colors: an empirical study

Speeded classification of visual events is sensitive to crossmodal intensity correspondence.

Attention Drives Visual Processing and Audiovisual Integration During Multimodal Communication

Crossmodal Correspondence Between Tonal Hierarchy and Visual Brightness: Associating Syntactic Structure and Perceptual Dimensions Across Modalities

Simple and complex crossmodal correspondences involving audition

Hearing How Smooth It Looks: Selective Attention and Crossmodal Perception in the Arts