Abstract:Human emotion is one of the most complex psychophysiological phenomena and has been reported to be affected significantly by music listening. It is supposed that there is an intrinsic relationship between human emotion and music, which can be modeled and predicted quantitatively in a supervised manner. Here, a heuristic clustering analysis is carried out on large-scale free music archive to derive a genre-diverse music library, to which the emotional response of participants is measured using a standard protocol, consequently resulting in a systematic emotion-to-music profile. Eight machine learning methods are employed to statistically correlate the basic sound features of music audio tracks in the library with the measured emotional response of tested people to the music tracks in a training set and to blindly predict the emotional response from sound features in a test set. This study found that nonlinear methods are more robust and predictable but considerably more time-consuming than linear approaches. The neural networks have strong internal fittability but are associated with a significant overfitting issue. The support vector machine and Gaussian process exhibit both high internal stability and satisfactory external predictability in all used methods; they are considered as promising tools to model, predict, and explain the intrinsic relationship between human emotion and music. The psychological basis and perceptional implication underlying the built machine learning models are also discussed to find out the key music factors that affect human emotion.

Music Emotion Fuzzy Computing Model Based on Evolving Kernel Clustering

A New Fuzzy Classifier For Music Emotion Based On Conditional Probability

Learning Music Emotion Primitives via Supervised Dynamic Clustering.

Linguistic computing model for music emotion

Music's Affective Computing Model Based on Fuzzy Logic

Human-centric Music Medical Therapy Exploration System

Study on Linguistic Computing for Music Emotion

Emotion-Driven Chinese Folk Music-Image Retrieval Based on De-Svm

Using Psychophysiologicalmeasures to Recognize Personalmusic Emotional Experience

Image–Music Synesthesia-Aware Learning Based on Emotional Similarity Recognition

Digital Empirical Research of Influencing Factors of Musical Emotion Classification Based on Pleasure-Arousal Musical Emotion Fuzzy Model

Emotional Recognition For Chime Bell Music

Web Music Emotion Recognition Based on Higher Effective Gene Expression Programming

Research on Emotional Vocabulary-Driven Personalized Music Retrieval

Machine Learning–based Modeling and Prediction of the Intrinsic Relationship Between Human Emotion and Music

User-Adaptive Music Emotion Recognition

Emotion Recognition of Western Tonal Music Using Support Vector Machine

Music emotion recognition based on middle and high level features

Automatic ECG-Based Emotion Recognition in Music Listening

Research and Implementation of Emotional Classification of Traditional Folk Songs Based on Joint Time-Frequency Analysis

FFA-BiGRU: Attention-Based Spatial-Temporal Feature Extraction Model for Music Emotion Classification