The impact of crossmodal predictions on the neural processing of aesthetic stimuli

Marianne Tiihonen,Niels Trusbak Haumann,Yury Shtyrov,Peter Vuust,Thomas Jacobsen,Elvira Brattico

DOI: https://doi.org/10.1098/rstb.2022.0418

2024-01-29

Abstract:Neuroaesthetic research has focused on neural predictive processes involved in the encounter with art stimuli or the related evaluative judgements, and it has been mainly conducted unimodally. Here, with electroencephalography, magnetoencephalography and an affective priming protocol, we investigated whether and how the neural responses to non-representational aesthetic stimuli are top-down modulated by affective representational (i.e. semantically meaningful) predictions between audition and vision. Also, the neural chronometry of affect processing of these aesthetic stimuli was investigated. We hypothesized that the early affective components of crossmodal aesthetic responses are dependent on the affective and representational predictions formed in another sensory modality resulting in differentiated brain responses, and that audition and vision indicate different processing latencies for affect. The target stimuli were aesthetic visual patterns and musical chords, and they were preceded by a prime from the opposing sensory modality. We found that early auditory-cortex responses to chords were more affected by valence than the corresponding visual-cortex ones. Furthermore, the assessments of visual targets were more facilitated by affective congruency of crossmodal primes than the acoustic targets. These results indicate, first, that the brain uses early affective information for predictively guiding aesthetic responses; second, that an affective transfer of information takes place crossmodally, mainly from audition to vision, impacting the aesthetic assessment. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.