Abstract:Audio features such as inharmonicity, noisiness, and spectral roll-off have been identified as correlates of "noisy" sounds. However, such features are likely involved in the experience of multiple semantic timbre categories of varied meaning and valence. This paper examines the relationships of stimulus properties and audio features with the semantic timbre categories raspy/grainy/rough, harsh/noisy, and airy/breathy. Participants (n = 153) rated a random subset of 52 stimuli from a set of 156 approximately 2-s orchestral instrument sounds representing varied instrument families (woodwinds, brass, strings, percussion), registers (octaves 2 through 6, where middle C is in octave 4), and both traditional and extended playing techniques (e.g., flutter-tonguing, bowing at the bridge). Stimuli were rated on the three semantic categories of interest, as well as on perceived playing exertion and emotional valence. Correlational analyses demonstrated a strong negative relationship between positive valence and perceived physical exertion. Exploratory linear mixed models revealed significant effects of extended technique and pitch register on valence, the perception of physical exertion, raspy/grainy/rough, and harsh/noisy. Instrument family was significantly related to ratings of airy/breathy. With an updated version of the Timbre Toolbox (R-2021 A), we used 44 summary audio features, extracted from the stimuli using spectral and harmonic representations, as input for various models built to predict mean semantic ratings for each sound on the three semantic categories, on perceived exertion, and on valence. Random Forest models predicting semantic ratings from audio features outperformed Partial Least-Squares Regression models, consistent with previous results suggesting that non-linear methods are advantageous in timbre semantic predictions using audio features. Relative Variable Importance measures from the models among the three semantic categories demonstrate that although these related semantic categories are associated in part with overlapping features, they can be differentiated through individual patterns of audio feature relationships.

The emotional characteristics of bass drums, snares, and disengaged snares with different strokes and dynamics

Using Psychophysiologicalmeasures to Recognize Personalmusic Emotional Experience

Emotional Connotations of Musical Instrument Timbre in Comparison With Emotional Speech Prosody: Evidence From Acoustics and Event-Related Potentials

Emotion recognition from sound stimuli based on back-propagation neural networks and electroencephalograms

Effects of the Musical Sound Environment on Communicating Emotion

Instrumental music training relates to intensity assessment but not emotional prosody recognition in Mandarin

Digital Empirical Research of Influencing Factors of Musical Emotion Classification Based on Pleasure-Arousal Musical Emotion Fuzzy Model

A Cross-Cultural Analysis of the Influence of Timbre on Affect Perception in Western Classical Music and Chinese Music Traditions

It's not what you play, it's how you play it: timbre affects perception of emotion in music

Musical Melody and Emotional Evocation - An Empirical Study from Statistical Analysis

Emotional Communicability in Music Therapy: Different Instruments for Different Emotions?

Construction of a Chinese traditional instrumental music dataset: A validated set of naturalistic affective music excerpts

Mapping Emotions into Acoustic Space: the Role of Voice Quality.

Affective and physiological responses to environmental noises and music

Spectral Characteristics of EEG during Active Emotional Musical Performance

Modeling Noise-Related Timbre Semantic Categories of Orchestral Instrument Sounds With Audio Features, Pitch Register, and Instrument Family

An empirical approach to the relationship between emotion and music production quality

Effect of sound sequence on soundscape emotions

Exploring Spatio-Spectral Electroencephalogram Modulations of Imbuing Emotional Intent During Active Piano Playing

Emotion rendering in music: range and characteristic values of seven musical variables

On Perceived Emotion in Expressive Piano Performance: Further Experimental Evidence for the Relevance of Mid-level Perceptual Features