The Analysis Of The Music Emotion Based On The Pleasure-Arousal-Dominance Model

Haibin Shi,Desheng Lv

2015-01-01

Abstract:In this paper, through the use of the Pleasure-Arousal-Dominance Model, a kind of music emotion analysis method is proposed. We use the Pleasure-Arousal-Dominance Model to put the dimension and category view's advantages together to assess the emotion of music.

What problem does this paper attempt to address?

Digital Empirical Research of Influencing Factors of Musical Emotion Classification Based on Pleasure-Arousal Musical Emotion Fuzzy Model

Jing-Xian He,Li Zhou,Zhen-Tao Liu,Xin-Yue Hu

DOI: https://doi.org/10.20965/jaciii.2020.p0872

2020-01-01

Journal of Advanced Computational Intelligence and Intelligent Informatics

Abstract:In recent years, with the further breakthrough of artificial intelligence theory and technology, as well as the further expansion of the Internet scale, the recognition of human emotions and the necessity for satisfying human psychological needs in future artificial intelligence technology development tendencies have been highlighted, in addition to physical task accomplishment. Musical emotion classification is an important research topic in artificial intelligence. The key premise of realizing music emotion classification is to construct a musical emotion model that conforms to the characteristics of music emotion recognition. Currently, three types of music emotion classification models are available: discrete category, continuous dimensional, and music emotion-specific models. The pleasure-arousal music emotion fuzzy model, which includes a wide range of emotions compared with other models, is selected as the emotional classification system in this study to investigate the influencing factor for musical emotion classification. Two representative emotional attributes, i.e., speed and strength, are used as variables. Based on test experiments involving music and non-music majors combined with questionnaire results, the relationship between music properties and emotional changes under the pleasure-arousal model is revealed quantitatively.
Linguistic computing model for music emotion

Xin Wang,Shouqian Sun,Chunlei Chai,Yongchuan Tang

2007-01-01

Journal of Computational Information Systems

Abstract:A new linguistic computing model for music emotion was proposed based on Hevner affective ring-a famous psychology model for emotion representation. Traditional study with aggregation methods does not accord with the actual process of human emotion cognition. In the proposed model, an 8-dimensional vector of linguistic labels was used to represent the emotion embodied in underlying music. Together with a method to measure the emotion similarity degree between any two pieces of music, the emotional space based on a set of basic linguistic labels was established. Finally, an experiment proved the model.
Using Psychophysiologicalmeasures to Recognize Personalmusic Emotional Experience

Le-kai Zhang,Shou-qian Sun,Bai-xi Xing,Rui-ming Luo,Ke-jun Zhang

DOI: https://doi.org/10.1631/fitee.1800101

IF: 2.526

2019-01-01

Frontiers of Information Technology & Electronic Engineering

Abstract:Music can trigger human emotion. This is a psychophysiological process. Therefore, using psychophysiological characteristics could be a way to understand individual music emotional experience. In this study, we explore a new method of personal music emotion recognition based on human physiological characteristics. First, we build up a database of features based on emotions related to music and a database based on physiological signals derived from music listening including EDA, PPG, SKT, RSP, and PD variation information. Then linear regression, ridge regression, support vector machines with three different kernels, decision trees, k-nearest neighbors, multi-layer perceptron, and Nu support vector regression (NuSVR) are used to recognize music emotions via a data synthesis of music features and human physiological features. NuSVR outperforms the other methods. The correlation coefficient values are 0.7347 for arousal and 0.7902 for valence, while the mean squared errors are 0.023 23 for arousal and 0.014 85 for valence. Finally, we compare the different data sets and find that the data set with all the features (music features and all physiological features) has the best performance in modeling. The correlation coefficient values are 0.6499 for arousal and 0.7735 for valence, while the mean squared errors are 0.029 32 for arousal and 0.015 76 for valence. We provide an effective way to recognize personal music emotional experience, and the study can be applied to personalized music recommendation.
Music Emotional Design by Evolutionary Algorithms

Zhang Kejun,Sun Shouqian

DOI: https://doi.org/10.1109/caidcd.2010.5681231

2010-01-01

Abstract:Music emotional design has been studied for many years, and there has been a growing interest in analyzing and design emotion in music by the evolutionary algorithms. Therefore, it's necessary to organize and categorize representative literature. The study presents an exhaustive survey of studies on one or more aspects of music emotional design by the evolutionary algorithms. In doing so, a classification of the literature based on the goal of what the studies want to achieve is developed. Such a classification not only highlights the significant results and unifies existing work, but also provides a foundation for future research in Music Emotional Design by the evolutionary algorithms.
Music's Affective Computing Model Based on Fuzzy Logic

Tao Liu,Bin Zhu,Shouqian Sun,Cheng Yang

DOI: https://doi.org/10.1109/wcica.2006.1713837

2006-01-01

Abstract:Music's affective computing model is an important research hotspot in computer music, which can be widely used in intelligent control, multimedia retrieval, human-machine interaction and entertainment robot. On the basis of analyzing the features of music' emotion connotation and its relation with basic audial elements, this paper brings forward some rules on music affective computing, and then constructs the architecture of music's emotion linguistic variable and defines the emotion based on fuzzy logic and Hevner's emotion loop. Afterwards, the paper illustrates the lens model of emotional communication and its utilization in fuzzy reasoning. Lastly, research on emotion recognition of music is described based on the affective computing model
Exploiting the emotional preference of music for music recommendation in daily activities

Hui Zhang,Kejun Zhang,Nick Bryan-Kinns

DOI: https://doi.org/10.1109/ISCID51228.2020.00085

2020-01-01

Abstract:The emotional use of music plays an important role in influencing people's music-searching behaviour. Many users listen to music for multiple mood regulation purposes. Therefore, emotional preference should be taken into consideration especially when building context-aware music recommendation systems which aim to satisfy users' short-term music needs. In addition, cultural differences will affect the way people experience and value emotion from music. Based on these aspects, we investigate the emotional preference of music in daily activities through a cross-cultural survey in China and the UK, and build emotional maps between activity and music for the two countries. Furthermore, we introduce EmoMusic, a novel emotion-based music recommendation service for daily activities which supports visualisation and control of music emotion through an interactive interface. A user study is presented to evaluate the application. Results reveal good usability of the service and show that visualization and interaction in a music emotion space can improve acceptance of music recommendations. Our work helps to understand the emotional preference of music for various activities and how to exploit emotional cues of music in a music recommendation service, paving the way for more user-centered music recommendation systems.
Automatic Music Emotion Classification Using a New Classification Algorithm

Xiaoyu Sun,Yongchuan Tang

DOI: https://doi.org/10.1109/ISCID.2009.281

2009-01-01

Abstract:Music emotion is a special emotion that is aroused by music which is a media that can convey human affection. Music emotion classification is a popular topic in recent years. The mood of a music clip describes emotional expression. It is helpful in music understanding, music retrieval and some other interesting music related application. In this paper, a method is proposed using a framework named information cell mixture models (ICMM) to automate the task of music emotion classification. This framework has potential application in both unsupervised concept learning and supervised classification learning. This framework is acceptable for music mood classification because emotion is a vague concept and has a cognitive structure. The application of ICMM is also suitable for music emotion classification.
Human-centric Music Medical Therapy Exploration System

Baixi Xing,Kejun Zhang,Lekai Zhang,Eng Keong Lua,Shouqian Sun

DOI: https://doi.org/10.1145/2491172.2491180

2013-01-01

Abstract:Music emotion analytic is useful for many human-centric applications such as medical intervention. Existing studies have shown that music is a low risk, adjunctive and therapeutic medical intervention. However, there is little existing research about the types of music with identified emotions that have the most effect for different medical applications. We would like to discover various music emotions through machine learning analytic so as to identify modelsof how music conveys emotion features, and determine its effectiveness for medical intervention and treatment. We are developing a Human-centric Music Medical Therapy Exploration System which could recognize music emotion features from Chinese Folk Music Library, and recommend suitable music to playback for medical intervention and treatment. Our networked system is based on Support Vector Machine(SVM) algorithm to construct the models for music emotion recognition and information retrieval. Our main contributions are as follows: Firstly, we built up the Chinese folk music emotions and features library; secondly, we conducted evaluation and comparison with other algorithms such as Back Propagation(BP) and Linear Regression to set up the model construction for music emotion recognition and proved that SVM has the best performance; lastly, we integrated blood pressure and heartbeat data analytic into our system to visualize the emotion fluctuation in different music affection and make recommendation for suitable humancentric music medical therapy for hypertensive patients.
Learning Music Emotion Primitives via Supervised Dynamic Clustering.

Yang Liu,Yan Liu,Xiang Zhang,Gong Chen,Kejun Zhang

DOI: https://doi.org/10.1145/2964284.2967215

2016-01-01

Abstract:This paper explores a fundamental problem in music emotion analysis, i.e., how to segment the music sequence into a set of basic emotive units, which are named as emotion primitives. Current works on music emotion analysis are mainly based on the fixed-length music segments, which often leads to the difficulty of accurate emotion recognition. Short music segment, such as an individual music frame, may fail to evoke emotion response. Long music segment, such as an entire song, may convey various emotions over time. Moreover, the minimum length of music segment varies depending on the types of the emotions. To address these problems, we propose a novel method dubbed supervised dynamic clustering (SDC) to automatically decompose the music sequence into meaningful segments with various lengths. First, the music sequence is represented by a set of music frames. Then, the music frames are clustered according to the valence-arousal values in the emotion space. The clustering results are used to initialize the music segmentation. After that, a dynamic programming scheme is employed to jointly optimize the subsequent segmentation and grouping in the music feature space. Experimental results on standard dataset show both the effectiveness and the rationality of the proposed method.
Music Waveform Analysis Based on SOM Neural Network and Big Data

Xinmei Zhang

DOI: https://doi.org/10.1155/2021/9714988

IF: 3.12

2021-01-01

Computational Intelligence and Neuroscience

Abstract:Music is an indispensable part of our life and study and is one of the most important forms of multimedia applications. With the development of deep learning and neural network in recent years, how to use cutting-edge technology to study and apply music has become a research hotspot. Music waveform is not only the main form of music frequency but also the basis of music feature extraction. This paper first designs a method of note extraction based on the fast Fourier transform principle of the audio signal packet route under the self-organizing map (SOM neural network) which can accurately extract the musical features of the note, such as amplitude, loudness, period, and so on. Secondly, the audio segments are divided into summary by adding window moving matching method, and the music features such as amplitude, loudness, and period of each bar are obtained according to the performance of audio signal in each bar. Finally, according to the similarity of the audio music theory of the adjacent summary of each bar, the audio segments are divided, and the music features of each segment are obtained. The traditional recurrent neural network (RNN) is improved, and the SOM neural network is used to recognize the audio emotion features. The final experimental results show that the proposed method based on SOM neural network and big data can effectively extract and analyze music waveform features. Compared with previous studies, this paper creatively proposed a new algorithm, which can more accurately and quickly extract and analyze the data sound waveform, and used SOM neural network to analyze the emotion model contained in music for the first time.
Research on music emotion cognition model based on linguistic value computing

Bin Zhu,Tao Liu,Yongchuan Tang

DOI: https://doi.org/10.1109/WCICA.2008.4594063

2008-01-01

Abstract:Research on musicpsilas affective computing model plays an important role in digital entertainment and harmonious human-machine interactive, and belongs to the field of artificial emotion. For modeling the music affective. There are two major insufficients in current researches such as: lack of knowledge expression and generalization. This paper presents a general model building process, and designs a cognizing test based on semantic difference for Chinese folk music. According to the studying about the data of experiment and relied on the GEP based on dynamic mutation operator, a model tally with the linguistic modeling theory is constructed, which is consistent with psychological consistent pattern of music emotion.
Study on Linguistic Computing for Music Emotion

SUN Shou-qian,WANG Xin,LIU Tao,TANG Yong-chuan

DOI: https://doi.org/10.3969/j.issn.1007-5321.2006.z2.008

2006-01-01

Abstract:A model for music affective computing based on Hevner affective ring-a famous psychology model for emotion representation was proposed. A 8-dimensional vector of linguistic labels is used to represent the emotion embodied in underlying music. And a new method is introduced to measure the emotion similarity between any two pieces of music. And then, the emotional space based on a set of basic linguistic labels is established via an experiment. Considering the requirements of emotional music retrieval and multi-expert decision, a linguistic information fusion method for music emotions based was presented on the arithmetic and logic operations on the emotional space, and the examples show that our model agrees with psychological pattern of the music recognition well and truly.
Music Emotion Research Based on Reinforcement Learning and Multimodal Information

Yue Hu

DOI: https://doi.org/10.1155/2022/2446399

2022-02-09

Journal of Mathematics

Abstract:Music is an important carrier of emotion and an indispensable factor in people’s daily life. With the rapid growth of digital music, people’s demand for music emotion analysis and retrieval is also increasing. With the rapid development of Internet technology, digital music has been derived continuously, and automatic recognition of music emotion has become the main research focus. For music, emotion is the most essential feature and the deepest inner feeling. Under the ubiquitous information environment, revealing the deep semantic information of multimodal information resources and providing users with integrated information services has important research and application value. In this paper, a multimodal fusion algorithm for music emotion analysis is proposed, and a dynamic model based on reinforcement learning is constructed to improve the analysis accuracy. The model dynamically adjusts the emotional analysis results by learning the user’s behavior, so as to realize the personalized customization of the user’s emotional preference.

mathematics
Intelligent Analysis of Music's Affective Features and Expressive Pattern

Yizhe Sun,Duo Xu,Yanqiang Xie,Weihui Dai

DOI: https://doi.org/10.1109/YAC51587.2020.9337700

2020-01-01

Abstract:Affective experience is the artistic charm that music brings to people. Existing studies have shown that people' preferences for affective features of music are significantly different and greatly affected by their psychological and physical status as well as the environment scenes where they are. Therefore, how to accurately extract and analyze music's affective features is of great significance for musical evaluation, appreciation, and composition, as well as for finding the proper music to match with people's preference best. This paper firstly built a group of acoustic parameters to extract the affective features of music, and then converted those parameters into the variables' values of Thayer model through machine learning. On this basis, the expressive pattern of music's affective features was described by the time series of the above affective value's changes. Experimental result showed that the proposed method provided an effective intelligent method for analyzing the affective features of music. Superiorly, it conducted the expressive pattern to reflect the dynamic changes of music's affective features.
Emotional Recognition For Chime Bell Music

Tao Liu,Shouqian Sun,Yunhe Pan

DOI: https://doi.org/10.1109/ICSMC.2004.1398360

2004-01-01

Abstract:Music emotion describes the inherent emotional connotation of a music clip. This paper aims to apply fuzzy strategies to studying emotional recognition of digital chime bell music, and a three-layer hierarchical framework is presented to automate the task of music emotion recognition from chime bell music data, by consulting some music experts as well as music literature. Firstly, this paper constructs an emotional loop as the emotional model for chime bell music. Secondly, a fuzzy multi-decision-making model for multi-object system and membership function are established. At last, by means of fuzzy math, the emotion of chime bell music is recognized. Experimental evaluations indicate that the proposed system can produce satisfactory results.
Intelligent Analysis Of Music'S Affective Features And Fxpressive Pattern

Yizhe Sun,Duo Xu,Yanqiang Xie,Weihui Dai

DOI: https://doi.org/10.1109/YAC51587.2020.9337700

2020-01-01

Abstract:Affective experience is the artistic charm that music brings to people. Existing studies have shown that people' preferences for affective features of musk are significantly different and greatly affected by their psychological and physical status as well as the environment scenes where they are. Therefore, how to accurately extract and analyze music's affective features is of great significance for musical evaluation, appreciation, and composition, as well as for finding the proper music to match with people's preference best. This paper firstly built a group of acoustic parameters to extract the affective features of music, and then converted those parameters into the variables' values of Thayer model through machine learning. On this basis, the expressive pattern of music's affective features was described by the time series of the above affective value's changes. Experimental result showed that the proposed method provided an effective intelligent method for analyzing the affective features of music. Superiorly, it conducted the expressive pattern to reflect the dynamic changes of music's affective features.
Psychological Emotion and Behavior Analysis in Music Teaching Based on the Attention, Relevance, Confidence, and Satisfaction Motivation Model

Dong Li

DOI: https://doi.org/10.3389/fpsyg.2022.917476

IF: 3.8

2022-06-28

Frontiers in Psychology

Abstract:The abbreviation ARCS in the ARCS motivational model comprises the first letters of four English words: Attention, Relevance, Confidence, and Satisfaction. The ARCS motivation model is based on a systematic and easy-to-operate motivation theory. Many research studies have verified the applicability and effectiveness of the ARCS model in education worldwide. The proposed optimized ARCS motivation model takes the traditional ARCS motivation model and systematically optimizes it to make it suitable for the coding of data from videos of music classes. The case analysis method selected 14 high-quality music lessons as the research object. The optimized ARCS model involves text conversion, coding, and statistical analysis of the transcripts of videos of high-quality music classes. The data analysis was used to analyze the characteristics of students’ emotional and behavioral motivation incentive strategies in each section of the ARCS motivation model in combination with specific high-quality case lesson fragments. This paper summarizes ways and means of using a motivational approach in the teaching of quality music classes, providing theoretical support for the practice of music teaching.

psychology, multidisciplinary
Musical Melody and Emotional Evocation - An Empirical Study from Statistical Analysis

Haitao Yu

DOI: https://doi.org/10.2478/amns-2024-1332

2024-01-01

Applied Mathematics and Nonlinear Sciences

Abstract:Abstract Music is a product of human conscious activity, which, as a special form of artistic expression, can directly hit the psyche and trigger people’s strong emotional experiences. In this study, the continuity of pitch significance is first utilized to represent the musical melody and the feature extraction of polyphonic musical melody is carried out based on harmonic peak and harmonic sum functions. Based on this basis, the features of the extracted musical melody are recognized by combining convolutional neural networks. In addition, the study also constructs an emotion evocation model based on musical melody, and empirically demonstrates the relationship between musical melody and emotion evocation using statistical analysis. The p-values of different music melodies and different music preferences are all less than 0.05. According to the difference analysis, sad emotions have an arousal rate of 90%, which makes them the easiest to induce and arouse. The p-value for the three factors between musical melody, gender, and professional background was less than 0.05, and the interaction was significant. Music melody, gender, and professional background of emotion evocation have a considerable difference. The influence of emotion evocation has a significant effect. While the role of music preferences on emotion evocation is not substantial, the trend and characteristics of different music melody types evoked emotions provide an effective and realistic basis.

Computer Science,Psychology
User-Adaptive Music Emotion Recognition

Muyuan Wang,Naiyao Zhang,Hancheng Zhu

DOI: https://doi.org/10.1109/icosp.2004.1441576

2004-01-01

Abstract:Music can arouse profound and deep emotional reactions, and the automatic emotion recognition of music is useful for music information retrieval. human-computer interaction and affective computing [1]. However, the nature of music is very complex, and users' emotion responses vary from individual to individual. In this paper, we present an adaptive scheme to recognize the emotional meaning of music, which is able to follow users' preference. The recognition process is consisted of four steps: first, a two-dimensional model, 'emotion plane' is used to model the emotion classes; second. novel musical perceptual features are extracted from MIDI files; then, different support vector machines (SVM) were trained according to different users' preferences, and finally these trained support vector machines are used to classify the emotion of music. Satisfying experimental results are obtained on western tonal music, with different users. That indicates the effectiveness of our approach.
MMD-MII Model: A Multilayered Analysis and Multimodal Integration Interaction Approach Revolutionizing Music Emotion Classification

Jingyi Wang,Alireza Sharifi,Thippa Reddy Gadekallu,Achyut Shankar

DOI: https://doi.org/10.1007/s44196-024-00489-6

IF: 2.259

2024-04-24

International Journal of Computational Intelligence Systems

Abstract:Music plays a vital role in human culture and society, serving as a universal form of expression. However, accurately classifying music emotions remains challenging due to the intricate nature of emotional expressions in music and the integration of diverse data sources. To address these challenges, we propose the Multilayered Music Decomposition and Multimodal Integration Interaction (MMD-MII) model. This model employs cross-processing to facilitate interaction between audio and lyrics, ensuring coherence in emotional representation. Additionally, we introduce a hierarchical framework based on the music theory, focusing on the main and chorus sections, with the chorus processed separately to extract precise emotional representations. Experimental results on the DEAM and FMA datasets demonstrate the effectiveness of the MMD-MII model, achieving accuracies of 49.68% and 49.54% respectively. Compared with the existing methods, our model outperforms in accuracy and F 1 scores, offering promising implications for music recommendation systems, healthcare, psychology, and advertising, where accurate emotional analysis is essential.

computer science, artificial intelligence, interdisciplinary applications

The Analysis Of The Music Emotion Based On The Pleasure-Arousal-Dominance Model

Digital Empirical Research of Influencing Factors of Musical Emotion Classification Based on Pleasure-Arousal Musical Emotion Fuzzy Model

Linguistic computing model for music emotion

Using Psychophysiologicalmeasures to Recognize Personalmusic Emotional Experience

Music Emotional Design by Evolutionary Algorithms

Music's Affective Computing Model Based on Fuzzy Logic

Exploiting the emotional preference of music for music recommendation in daily activities

Automatic Music Emotion Classification Using a New Classification Algorithm

Human-centric Music Medical Therapy Exploration System

Learning Music Emotion Primitives via Supervised Dynamic Clustering.

Music Waveform Analysis Based on SOM Neural Network and Big Data

Research on music emotion cognition model based on linguistic value computing

Study on Linguistic Computing for Music Emotion

Music Emotion Research Based on Reinforcement Learning and Multimodal Information

Intelligent Analysis of Music's Affective Features and Expressive Pattern

Emotional Recognition For Chime Bell Music

Intelligent Analysis Of Music'S Affective Features And Fxpressive Pattern

Psychological Emotion and Behavior Analysis in Music Teaching Based on the Attention, Relevance, Confidence, and Satisfaction Motivation Model

Musical Melody and Emotional Evocation - An Empirical Study from Statistical Analysis

User-Adaptive Music Emotion Recognition

MMD-MII Model: A Multilayered Analysis and Multimodal Integration Interaction Approach Revolutionizing Music Emotion Classification