Abstract:Audio features such as inharmonicity, noisiness, and spectral roll-off have been identified as correlates of "noisy" sounds. However, such features are likely involved in the experience of multiple semantic timbre categories of varied meaning and valence. This paper examines the relationships of stimulus properties and audio features with the semantic timbre categories raspy/grainy/rough, harsh/noisy, and airy/breathy. Participants (n = 153) rated a random subset of 52 stimuli from a set of 156 approximately 2-s orchestral instrument sounds representing varied instrument families (woodwinds, brass, strings, percussion), registers (octaves 2 through 6, where middle C is in octave 4), and both traditional and extended playing techniques (e.g., flutter-tonguing, bowing at the bridge). Stimuli were rated on the three semantic categories of interest, as well as on perceived playing exertion and emotional valence. Correlational analyses demonstrated a strong negative relationship between positive valence and perceived physical exertion. Exploratory linear mixed models revealed significant effects of extended technique and pitch register on valence, the perception of physical exertion, raspy/grainy/rough, and harsh/noisy. Instrument family was significantly related to ratings of airy/breathy. With an updated version of the Timbre Toolbox (R-2021 A), we used 44 summary audio features, extracted from the stimuli using spectral and harmonic representations, as input for various models built to predict mean semantic ratings for each sound on the three semantic categories, on perceived exertion, and on valence. Random Forest models predicting semantic ratings from audio features outperformed Partial Least-Squares Regression models, consistent with previous results suggesting that non-linear methods are advantageous in timbre semantic predictions using audio features. Relative Variable Importance measures from the models among the three semantic categories demonstrate that although these related semantic categories are associated in part with overlapping features, they can be differentiated through individual patterns of audio feature relationships.

Timbre Identification of Instrumental Music Via Energy Distribution Modeling.

Human-centric Music Medical Therapy Exploration System

Using Psychophysiologicalmeasures to Recognize Personalmusic Emotional Experience

Musical Instrument Classification via Low-Dimensional Feature Vectors

Using Statistic Model to Capture the Association Between Timbre and Perceived Tempo.

Modeling Noise-Related Timbre Semantic Categories of Orchestral Instrument Sounds With Audio Features, Pitch Register, and Instrument Family

Time-Frequency Scattering Accurately Models Auditory Similarities Between Instrumental Playing Techniques

Analysis of Rehabilitation Occupational Therapy Techniques Based on Instrumental Music Chinese Tonal Language Spectrogram Analysis

Mining the Performance Characteristics of Yao Nationality Musical Instruments under Multivariate Statistical Analysis

A Cross-Cultural Analysis of the Influence of Timbre on Affect Perception in Western Classical Music and Chinese Music Traditions

The Timbre Toolbox: extracting audio descriptors from musical signals

Characterizing prototypical musical instrument timbres with Timbre Trait Profiles

Violin Music Timeliness and Aesthetics Evaluation System Based on Melody Signal Cyclic Fluctuation Matching Algorithm

Label-Specific Time-Frequency Energy-Based Neural Network for Instrument Recognition

Research and Implementation of Identifying Music through Performances Using Entropy Based Audio-fingerprint

Acoustical feature analysis and optimization for aesthetic recognition of Chinese traditional music

Digital Empirical Research of Influencing Factors of Musical Emotion Classification Based on Pleasure-Arousal Musical Emotion Fuzzy Model

Exploring quantitative indices to characterize piano timbre with precision validated using measurement system analysis

Intelligent Analysis Of Music'S Affective Features And Fxpressive Pattern

Towards Cross-Cultural Analysis using Music Information Dynamics

Music Waveform Analysis Based on SOM Neural Network and Big Data