Abstract:Conveying emotions in spoken poetry may be based on a poem's semantic content and/or on emotional prosody, i.e., on acoustic features above single speech sounds. However, hypotheses of more direct sound-emotion relations in poetry, such as those based on the frequency of occurrence of certain phonemes, have not withstood empirical (re)testing. Therefore, we investigated sound-emotion associations based on prosodic features as a potential alternative route for the, at least partially, non-semantic expression and perception of emotions in poetry. We first conducted a pre-study designed to validate relevant parameters of joy- and sadness-supporting prosody in the recitation, i.e. acoustic production, of poetry. The parameters obtained thereof guided the experimental modification of recordings of German joyful and sad poems such that for each poem, three prosodic variants were constructed: one with a joy-supporting prosody, one with a sadness-supporting prosody, and a neutral variant. In the subsequent experiment, native German speakers and participants with no command of German rated the joyfulness and sadness of these three variants. This design allowed us to investigate the role of emotional prosody, operationalized in terms of sound-emotion parameters, both in combination with and dissociated from semantic access to the emotional content of the poems. The findings from our pre-study showed that the emotional content of poems (based on pre-classifications into joyful and sad) indeed predicted the prosodic features pitch and articulation rate. The subsequent perception experiment revealed that cues provided by joyful and sad prosody specifically affect non-German-speaking listeners' emotion ratings of the poems. Thus, the present investigation lends support to the hypothesis of prosody-based iconic relations between perceived emotion and sound qualia. At the same time, our findings also highlight that semantic access substantially decreases the role of cross-language sound-emotion associations and indicate that non-German-speaking participants may also use phonetic and prosodic cues other than the ones that were targeted and manipulated here.

The role of valence and arousal for phonological iconicity in the lexicon of German: a cross-validation study using pseudoword ratings

Phonetic underpinnings of sound symbolism across multiple domains of meaning

Prominence effects in vocal iconicity: Implications for lexical access and language change

Emotion from the sound of a word: Statistical relationships between surface form and valence of English words influence lexical access and memory.

Valence without meaning: Investigating form and semantic components in pseudowords valence

Differential contributions of the spectro-temporal and vocal characteristics of auditory pseudowords to multiple sound-symbolic mappings

Emojis and affective priming in visual word recognition

The Role of the Valence, Arousing Properties and Subjective Significance of Subliminally Presented Words in Affective Priming

Emotional connotations of words related to authority and community

Sound symbolic associations in Spanish emotional words: affective dimensions and discrete emotions

Towards emotion recognition in texts: A sound-symbolic experiment

Iconicity in the lab: a review of behavioral, developmental, and neuroimaging research into sound-symbolism

Prosody-Based Sound-Emotion Associations in Poetry

Poetics of reduplicative word formation: evidence from a rating and recall experiment

Assessing sound symbolism: Investigating phonetic forms, visual shapes and letter fonts in an implicit bouba-kiki experimental paradigm

Iconicity ratings for 10,995 Spanish words and their relationship with psycholinguistic variables

Stimulus Parameters Underlying Sound-Symbolic Mapping of Auditory Pseudowords to Visual Shapes

The influence of language-specific properties on the role of consonants and vowels in a statistical learning task of an artificial language: A cross-linguistic comparison

Decoding the essence of two-character Chinese words: Unveiling valence, arousal, concreteness, familiarity, and imageability through word norming

Are tones in the expressive lexicon iconic? Evidence from three Chinese languages

Hot Speech and Exploding Bombs: Autonomic Arousal During Emotion Classification of Prosodic Utterances and Affective Sounds