Music Recognition Algorithm Based on HMM

许琳,王作英

DOI: https://doi.org/10.3969/j.issn.1000-3428.2004.10.051

2004-01-01

Abstract:The research for music recognition has been started from 1970s, the 20th century.Yet recently, the performance has not been satisfied.The paper presents new recognition method based on HMM , and describes some related problem.

What problem does this paper attempt to address?

Application of Hidden Markov Chain and Artificial Neural Networks in Music Recognition and Classification

Wei Huang,Yuting Zhang

DOI: https://doi.org/10.1145/3379247.3379276

2020-01-04

Abstract:This paper presents a method for modeling and analyzing music recognition problems. The presented method is a hidden Markov chain (Hidden Markov Models, HMM) combined with artificial neural networks (Artificial Neural Network, ANN). This method can be considered as an improvement of the classical HMM method with the use of the ANN. In this paper, the modeling of music recognition and algorithm implementation is discussed. The algorithm is then applied to the actual music classification problem. An analysis of its performance as compared to the conventional HMM-only method and ANN-only method is provided. The hidden Markov process model is faster but suffers severe performance degradation when dealing with a large number of categories. Meanwhile, the artificial neural network method has better classification performance, but the computation complexity is higher compared to the hidden Markov model. The proposed method, which is the combination of the two methods, can improve the recognition accuracy of the HMM by 4 to 5 percent while ensuring a similar time-complexity as the conventional HMM.
Automatic Music Emotion Classification Using a New Classification Algorithm

Xiaoyu Sun,Yongchuan Tang

DOI: https://doi.org/10.1109/ISCID.2009.281

2009-01-01

Abstract:Music emotion is a special emotion that is aroused by music which is a media that can convey human affection. Music emotion classification is a popular topic in recent years. The mood of a music clip describes emotional expression. It is helpful in music understanding, music retrieval and some other interesting music related application. In this paper, a method is proposed using a framework named information cell mixture models (ICMM) to automate the task of music emotion classification. This framework has potential application in both unsupervised concept learning and supervised classification learning. This framework is acceptable for music mood classification because emotion is a vague concept and has a cognitive structure. The application of ICMM is also suitable for music emotion classification.
Research of Numbered Musical Notation Recognition Method

JIANG Yi-nv,ZHANG Yin,ZHANG San-yuan

DOI: https://doi.org/10.3321/j.issn:1002-8331.2006.32.062

2006-01-01

Abstract:Numbered Musical Notation(NMN) is one of the most familiar and common music scores,but it is seldom that anyone studies about its recognition in Optical Music Recognition(OMR) field at present,and everyone focuses on the research of Staff Score Recognition.In the base of deeply study of the features of NMN,this paper proposes an approach of fulfilling the recognition.After pre-dealing the inputted optical MNM,extracts the NMN part according to the bar line feature at first,then locates primitive objects through projections and flood-fill algorithms,and uses diverse algorithms to recognize the type of every primitive object,lastly assembles them to musical features form digital musical score.The result of the experiment indicates the satisfying effect that achieved by using this method to recognize the NMN.
Music Identification Using Embedded HMM.

Kai Chen,Sheng Gao,Peiqi Chai,Qibin Sun

DOI: https://doi.org/10.1109/MMSP.2005.248550

2006-01-01

Abstract:In this paper, we propose a new method for music identification based on Embedded Hidden Markov Model (EHMM). Differing from conventional HMM, the EHMM estimates the emission probability of its external HMM from the second, state specific HMM, which is referred as internal HMM EHMM clusters the feature blocks with its external HMM and describes spectral and the temporal structures of each feature block with its internal HMM. Our analysis and experimental results show that the proposed method for music identification achieves higher accuracy and lower complexity than previous approaches.
Linear Hidden Markov Model for Music Information Retrieval Based on Humming.

BL Liu,YD Wu,Y Li

DOI: https://doi.org/10.1109/icassp.2003.1200024

2004-01-01

Abstract:Recently, some studies have placed emphasis on statistical analysis in music information retrieval (MIR). The paper is concerned with applying a linear hidden Markov model (HMM) with three kinds of states, S, C and D, as the matching mechanism for a query by a humming system. Note segmentation, pitch tracking and the database of the system are briefly introduced. The paper analyzes six probable errors in humming and proposes the SCD HMM to model each song. Each of the states, S, C and D, represents two of the six errors. The SCD HMM describes all kinds of possibilities of errors in a hummed query. Each query can find a most probable state sequence in a SCD HMM and get a probability score that determines the similarity between the query and the candidate songs. The retrieval system contains about 1000 Chinese folk songs. Experimental results show that the model is robust to the six errors and generally a 90% matching accuracy (listed on top 5) can be achieved.
New Approach to Classification of Chinese Folk Music Based on Extension of HMM

XiaoBing Liu,DeShun Yang,XiaoOu Chen

DOI: https://doi.org/10.1109/icalip.2008.4590068

2008-01-01

Abstract:Recently, class labels are commonly used to structure the increasing amounts of music available in digital form on the Web and are important for music information retrieval. An evaluation for automatic classification of Chinese folk music according to an audio taxonomy is presented. The audio taxonomy is organized as hierarchical, resulting in good coverage of Chinese folk music. Continuous Hidden Markov Model(CHMM) have been widely used to model the temporal evolution of dynamic sounds, especially music signal, whereas with an obvious drawback that the probability of time spends in a particular state, or state occupancy is geometrically distributed, which is not the case in real music signal. In this paper, we presented two extensions of standard HMM: Hidden semi-Markov Model(HSMM), and Segmentation Duration-Based HMM(SDBHMM), providing a comparison among them and Continuous Hidden Markov Model(CHMM). The former extension has been presented in speech recognition and we proposed the later one originally. Our result show that SDBHMM could achieve classification accuracy of 92.49% approximately and HSMM with 90.02%, both of which outperform standard CHMM.
Application and Research on Optical Music Recognition

刘晓翔,张树生,王贺,朱玉璋

DOI: https://doi.org/10.3969/j.issn.1000-3428.2003.02.006

2003-01-01

Abstract:The paper introduces the technique of optical music recognition (OMR) which suggests the automatic recognition of music notation by computer. An OMR system uses a scanned image of a printed score as input, while its output could be a text-to-audio transcribed file, to provide user with editing or hearing functionalities of the recognition results. Subsequent processing on this output can provide a wide variety of applications, such as reprinting, computer aid music teaching and digital music library, etc. Then, this paper discusses four key areas of OMR techniques: image pre-processing; staff line detection and removing; primitive musical objects recognition; feature musical objects reasoning and reconstruction.
Automatic Audio Classification Based on EMGD_HMM

WANG Chao,WU Ya-feng

DOI: https://doi.org/10.3969/j.issn.1002-8684.2007.11.014

2007-01-01

Abstract:Automatic audio classification is one of the significant methods to extract content semantics from audio. An improved classifier based on EMGD_HMM(Ergodic Mixed Gaussian Density Hidden Markov Model) is proposed to classify audio in speech, music, and their mixture. The experimental results show that compared with left-right DHMM(left-right Density Hidden Markov Model), EMGD_HMM achieves better classification accuracy.
Investigation on the use of Hidden-Markov Models in automatic transcription of music

D. Cazau,G. Nuel

DOI: https://doi.org/10.48550/arXiv.1704.03711

2017-04-12

Abstract:Hidden Markov Models (HMMs) are a ubiquitous tool to model time series data, and have been widely used in two main tasks of Automatic Music Transcription (AMT): note segmentation, i.e. identifying the played notes after a multi-pitch estimation, and sequential post-processing, i.e. correcting note segmentation using training data. In this paper, we employ the multi-pitch estimation method called Probabilistic Latent Component Analysis (PLCA), and develop AMT systems by integrating different HMM-based modules in this framework. For note segmentation, we use two different twostate on/o? HMMs, including a higher-order one for duration modeling. For sequential post-processing, we focused on a musicological modeling of polyphonic harmonic transitions, using a first- and second-order HMMs whose states are defined through candidate note mixtures. These different PLCA plus HMM systems have been evaluated comparatively on two different instrument repertoires, namely the piano (using the MAPS database) and the marovany zither. Our results show that the use of HMMs could bring noticeable improvements to transcription results, depending on the instrument repertoire.

Machine Learning,Sound
Solfeggio Teaching Method Based on MIDI Technology in the Background of Digital Music Teaching

Shuo Shen,Kehui Wu

DOI: https://doi.org/10.4018/ijwltt.331085

2023-09-29

International Journal of Web-Based Learning and Teaching Technologies

Abstract:This research aims at teaching solfeggio and ear training in college music and proposes a teaching method for college music note recognition that combines the musical instrument digital interface (MIDI) and hidden Markov models (HMM). The experiment showcases that after preprocessing the music frequency sample signal using HMM model, it achieves the target accuracy after 20 times of training. From the HMM transition probability matrix diagram estimated from all training data sets, it can be seen that the transition matrix is close to the diagonal matrix. This indicates its high transfer efficiency. This study compares the HMM model with the other two algorithms, and the results show that its accuracy rate is about 99.56%. The probability of insertion errors and elimination errors is 0.52% and 2.58%. This is superior to the other two algorithms. In summary, the HMM model proposed in the study has extremely strong performance in the teaching of music note feature recognition in universities and can provide better teaching methods.
A real-time algorithm for music recognition based on wavelet transform

Cao Zheng,Guan Shengxiao,Wang Zengfu

DOI: https://doi.org/10.1109/WCICA.2006.1713937

2006-01-01

Abstract:This paper presents a new real-time algorithm for music recognition. According to music characteristics, we analyzed spectrum at the music pitches frequencies by using wavelet transform and DTFT, which increases not only the computing efficiency but also the resistance to noise. We advance a recognition strategy of note voting and music segmentation. New recognition rules for chords recognition are also presented. Experimental results show that our algorithm is fast and effective. © 2006 IEEE.
GMM Based Intelligent Detection of the Vocal Segment in Popular Music

李丽娟,叶茂,赵欣

2009-01-01

Abstract:Effective detection of vocal segment in popular music is very valuable in many applications.such as music retrieval.browsing.and cataloguing in a large database.melody extraction and singer recognition.The feature vector used to analyze the music signal in this paper is Mel-Frequency Cepstral Coeffcient which is generally used in speech signal processing.The methods of training GMM are applied to create the corresponding GMM for the non-vocal and vocal in a music respectively.which can achieve the goal of intelligent detection of vocal segment.In contrast to the conventional GMM training methods.using one group of training data which are hand-labeled as non-vocal and vocal to create one model for each class.On the other hand,in this paper.another GMM is created for each class using a group of pure vocal data and a group of pure non-vocal data respectively.And the probability models are obtained through the means of linear combination of the two GMMs of each class.The decision function used in this paper is likelihood probability classifier.The experiment results show that this method can improve the performance of the detection.
Audio-visual emotion recognition based on Hidden Markov Model

Jingxuan Zhao,Xiao Wu,Dongmei Jiang

DOI: https://doi.org/10.1007/978-3-642-25778-0-14

2012-01-01

Abstract:Recognizing emotions in the elderly and disabled people is an essential part in knowing whether they need help. In this paper, a study is presented for audio visual emotion recognition based on Hidden Markov Model (HMM). In the realm of audio visual emotion recognition, feature extraction of audio visual emotion and HMM training are very important issues. Emotion features of speech and facial image sequences are extracted and the HTK toolkit is adopted to train the hidden Markov models for audio, visual and audio-visual multi-stream emotion recognition. In general, the recognition rates of audio-visual multi-stream HMMs are slightly higher than the audio only HMM and visual only HMM, and the recognition rates of negative emotions are slightly than positive emotions. © 2012 Springer-Verlag Berlin Heidelberg.
Aided Recognition and Training of Music Features Based on the Internet of Things and Artificial Intelligence

Xidan Zhang

DOI: https://doi.org/10.1155/2022/3733818

IF: 3.12

2022-03-11

Computational Intelligence and Neuroscience

Abstract:With the development of the Internet of Things, many industries have been on the train of the information age, and digital audio technology is also constantly developing. Music retrieval has gradually become a research hotspot in the music industry. Among them, the auxiliary recognition of music characteristics is also a particularly important Task. Music retrieval is mainly to manually extract music signals, but now the music signal extraction technology has encountered a bottleneck. The article uses Internet and artificial intelligence technology to design an SNN music feature recognition model to identify and classify music features. The research results of the article show (1) statistic graphs of the main melody and accompanying melody of different music. The absolute value of the main melody and accompanying melody mainly fluctuates in the range of 0–7, and the proportion of the main melody can reach 36%. The accompanying melody can reach 17%. After the absolute value of the interval reaches 13, the interval ratio of the main melody and the accompanying melody tends to be stable, maintaining between 0.6 and 0.9, and the melody interval ratio value completely coincides; the main melody in the interval variable is X. (1) The relative difference value in the interval of −X(16) fluctuates greatly. After the absolute value of the interval reaches 17, the interval ratio of the main melody and the accompanying melody tends to be stable, maintaining between 0.01 and 0.04 and the main melody. The value of the difference is always higher than the accompanying melody. (2) When the number of feature maps is 24 ∗ 5 , the recognition result is the most accurate, MAP recognition result can reach 78.8, and the recognition result of precision@ is 79.2; when the feature map size is 5 ∗ 5 , the recognition result is the most accurate, MAP recognition result can reach 78.9, the recognition result of precision@ is 79.2, and the recognition result of HAM2 (%) is 78.6. The detection accuracy of the SNN music recognition model proposed in the article is the highest. When the number of bits is 64, the detection accuracy of the SNN detection model is 59.2%, and the detection accuracy of the improved SNN music recognition model is 79.3%, which is better than the detection rate of ITQ music recognition model of 17.9%, which is 61.4% higher. The experimental data further shows that the detection efficiency of the ITQ music recognition model is the highest. (3) The SNN music recognition model proposed in the article has the highest detection accuracy, regardless of whether it is in a noisy or no-noise music environment, with an accuracy rate of 97.97% and a detection accuracy value of 0.88, which is 5 types of music. The highest one among the recognition models, the ITQ music recognition model, has the lowest detection accuracy, with a detection accuracy of 67.47% in the absence of noise and a detection accuracy of 70.23% in the presence of noise. Although there is a certain noise removal technology, it can suppress noise interference to a certain extent, but cannot accurately describe music information, and the detection accuracy rate is also low.

mathematical & computational biology,neurosciences
Application of DHMM to mechanical equipment audio recognition

Peng SU,Jian CHENG

DOI: https://doi.org/10.3778/j.issn.1002-8331.1302-0160

2015-01-01

Abstract:In order to monitor, diagnose and identify the machinery or equipment, the audio signal is used as the monitoring means, and the Vector Quantization(VQ)algorithm is introduced, also mechanical equipment’s Discrete Hidden Markov Model(DHMM)is established. The mechanical equipment audio parameter extracted is MFCC, and the code book is pro-duced using Linde-Buzo-Gray(LBG)algorithm. The Baum-Welch algorithm’s simplest scaling factor form based on mul-tiple sequences is deduced. Meanwhile logarithmic form of Viterbi algorithm is used. Various forms of HMM model are compared through the experiments, and the suitable audio HMM model form for mechanical equipment is chosen. The experiments on 22 kinds of audio signals, with the recognition accuracy rate of more than 97%, prove the validity of the method.
Music Waveform Analysis Based on SOM Neural Network and Big Data

Xinmei Zhang

DOI: https://doi.org/10.1155/2021/9714988

IF: 3.12

2021-01-01

Computational Intelligence and Neuroscience

Abstract:Music is an indispensable part of our life and study and is one of the most important forms of multimedia applications. With the development of deep learning and neural network in recent years, how to use cutting-edge technology to study and apply music has become a research hotspot. Music waveform is not only the main form of music frequency but also the basis of music feature extraction. This paper first designs a method of note extraction based on the fast Fourier transform principle of the audio signal packet route under the self-organizing map (SOM neural network) which can accurately extract the musical features of the note, such as amplitude, loudness, period, and so on. Secondly, the audio segments are divided into summary by adding window moving matching method, and the music features such as amplitude, loudness, and period of each bar are obtained according to the performance of audio signal in each bar. Finally, according to the similarity of the audio music theory of the adjacent summary of each bar, the audio segments are divided, and the music features of each segment are obtained. The traditional recurrent neural network (RNN) is improved, and the SOM neural network is used to recognize the audio emotion features. The final experimental results show that the proposed method based on SOM neural network and big data can effectively extract and analyze music waveform features. Compared with previous studies, this paper creatively proposed a new algorithm, which can more accurately and quickly extract and analyze the data sound waveform, and used SOM neural network to analyze the emotion model contained in music for the first time.
Research Based on the Application and Exploration of Artificial Intelligence in the Field of Traditional Music

Yi Yang,Xia Huang

DOI: https://doi.org/10.1155/2022/5093044

IF: 2.336

2022-07-08

Journal of Sensors

Abstract:Traditional Chinese music has undergone trials and tribulations. To date, traditional music has been gradually improved, preserved, and passed down, both in terms of theoretical works and traditional music varieties. However, the current state of traditional music is still a cause for concern. Whether it is scholars engaged in the study of traditional music, universities, or local government agencies, there are still areas that need to be improved individually. The need to cultivate a future audience for traditional music and to make full use of new media such as the Internet is a priority at this stage. The emergence of any new technology is bound to have some impact on the existing social system, and the emergence of artificial intelligence is no exception. Due to the limitation of technology, only a small number of basic applications have been developed, and it is the future mission of research workers whether they can develop more advanced products for music lovers to experience on the basis of ensuring the basic maturity of these applications. In this paper, we introduce the convolutional deep belief network model based on the restricted Boltzmann machine and apply the convolutional deep belief network algorithm to the music melody recognition. Firstly, it was pretrained by an unsupervised greedy layer-by-layer algorithm. Then, the network parameters were fine-tuned by a supervised network training method, and the recognition ability of the model was improved by adjusting the network parameters. The experimental results show that the recognition effect of the system is more obvious under the condition that the length of music samples is 3 s, and the recognition effect is better when the number of model layers is 2 than that when the number of layers is 1.

engineering, electrical & electronic,instruments & instrumentation
A Hybrid Approach for Chinese Named Entity Recognition in Music Domain

Xueqing Zhang,Zhen Liu,Huizhong Qiu,Yan Fu

DOI: https://doi.org/10.1109/dasc.2009.27

2009-01-01

Abstract:The amount of music information available on the Web is rapidly increasing. There is a pressing need for music information extraction. To extract useful information from natural language text, we must recognize music named entities first. This paper introduces a hybrid method to identify the Chinese named entities in music domain. Recently, machine learning approaches are frequently used to solve name entity recognition (NER). So our method uses a hidden Markov model (HMM) as the underlying method. Since HMM has innate weaknesses, we incorporate it with rule-based method for pre-processing and post-processing. The combination of machine learning method and rule-based method results in a high precision recognition. And we improve both training and recognizing process of HMM for music named entity recognition (MNER). In this paper, a novel and convenient musical name entity (MNE) tagging method to generate training data is proposed, which makes HMM method practically usable. In addition, we present an effective method of unknown words tagging in recognition. The experimental results show that our framework brings significant improvements for solving MNER.
An improved algorithm for HMM speaker-independent speech recognition based on wavelet denoising

LI Jin,HE Pei-yu

DOI: https://doi.org/10.3969/j.issn.0490-6756.2007.01.015

2007-01-01

Abstract:The theory of wavelet denoising is applied in the hidden Markov model(HMM) algorithm,which enhances the signal-to-noise ratio(SNR) and recognition accuracy.By denoising and endpoints detecting in each speech,both computational load and training-time are reduced,and the recognition performance is improved.Compared with the dynamic time warping(DTW),the improved HMM algorithm has a better recognition performance in speaker-independent speech recognition.
Long Short-Term Memory-Based Music Analysis System for Music Therapy

Ya Li,Xiulai Li,Zheng Lou,Chaofan Chen

DOI: https://doi.org/10.3389/fpsyg.2022.928048

IF: 3.8

2022-06-15

Frontiers in Psychology

Abstract:Music can express people's thoughts and emotions. Music therapy is to stimulate and hypnotize the human brain by using various forms of music activities, such as listening, singing, playing and rhythm. With the empowerment of artificial intelligence, music therapy technology has made innovative development in the whole process of "diagnosis, treatment and evaluation." It is necessary to make use of the advantages of artificial intelligence technology to innovate music therapy methods, ensure the accuracy of treatment schemes, and provide more paths for the development of the medical field. This paper proposes an long short-term memory (LSTM)-based generation and classification algorithm for multi-voice music data. A Multi-Voice Music Generation system called MVMG based on the algorithm is developed. MVMG contains two main steps. At first, the music data are modeled to the MDPI and text sequence data by using an autoencoder model, including music features extraction and music clip representation. And then an LSTM-based music generation and classification model is developed for generating and analyzing music in specific treatment scenario. MVMG is evaluated based on the datasets collected by us: the single-melody MIDI files and the Chinese classical music dataset. The experiment shows that the highest accuracy of the autoencoder-based feature extractor can achieve 95.3%. And the average F1-score of LSTM is 95.68%, which is much higher than the DNN-based classification model.

psychology, multidisciplinary

Music Recognition Algorithm Based on HMM

Application of Hidden Markov Chain and Artificial Neural Networks in Music Recognition and Classification

Automatic Music Emotion Classification Using a New Classification Algorithm

Research of Numbered Musical Notation Recognition Method

Music Identification Using Embedded HMM.

Linear Hidden Markov Model for Music Information Retrieval Based on Humming.

New Approach to Classification of Chinese Folk Music Based on Extension of HMM

Application and Research on Optical Music Recognition

Automatic Audio Classification Based on EMGD_HMM

Investigation on the use of Hidden-Markov Models in automatic transcription of music

Solfeggio Teaching Method Based on MIDI Technology in the Background of Digital Music Teaching

A real-time algorithm for music recognition based on wavelet transform

GMM Based Intelligent Detection of the Vocal Segment in Popular Music

Audio-visual emotion recognition based on Hidden Markov Model

Aided Recognition and Training of Music Features Based on the Internet of Things and Artificial Intelligence

Application of DHMM to mechanical equipment audio recognition

Music Waveform Analysis Based on SOM Neural Network and Big Data

Research Based on the Application and Exploration of Artificial Intelligence in the Field of Traditional Music

A Hybrid Approach for Chinese Named Entity Recognition in Music Domain

An improved algorithm for HMM speaker-independent speech recognition based on wavelet denoising

Long Short-Term Memory-Based Music Analysis System for Music Therapy