Abstract:With the exponential growth in the production creation of multimedia data, there is an increasing need for video semantic analysis. Audio, as a significant part of video, provides important cues to human perception when humans are browsing and understanding video contents. To detect semantic content by useful audio information, we introduce audio keywords which are sets of specific audio sounds related to semantic events. In our previous work, we designed a hierarchical Support Vector Machine (SVM) classifier for audio keyword identification. However, a weakness of our previous work is that audio signals are artificially segmented into 20 ms frames for frame-based SVM identification without any contextual information. In this paper, we propose a classification method based on Hidden Markov Modal (HMM) for audio keyword identification as an improved work instead of using hierarchical SVM classifier. Choosing HMM is motivated by the successful story of HMM in speech recognition. Unlike the frame-based SVM classification followed by major voting, our proposed HMM-based classifiers treat specific sound as a continuous time series data and employ hidden states transition to capture context information. In particular, we study how to find an effective HMM, i.e., determining topology, observation vectors and statistical parameters of HMM. We also compare different HMM structures with different hidden states, and adjust time series data with variable length. Experimental data includes 40 minutes basketball au-dio which comes from real-time sports games. Experimental results show that, for audio keyword generation, the proposed HMM-based method outperforms the previous hierarchical SVM.

New Approach to Classification of Chinese Folk Music Based on Extension of HMM

Automatic Music Emotion Classification Using a New Classification Algorithm

A New Fuzzy Classifier For Music Emotion Based On Conditional Probability

An Approach Based on Reverse Hidden Markov Model for Audio Classification

Music Identification Using Embedded HMM.

Investigation on the use of Hidden-Markov Models in automatic transcription of music

Application of Hidden Markov Chain and Artificial Neural Networks in Music Recognition and Classification

Hybrid Svm/Hmm Approach For Audio Classification

A classification approach to interpretation of traditional Chinese musical score

Research on Yunnan Folk Music Classification Based on the Features of HHT-MFCC.

HMM-Based Audio Keyword Generation

Improvement of hidden Markov model (HMM) for speech recognition

Solfeggio Teaching Method Based on MIDI Technology in the Background of Digital Music Teaching

Music Genres Classification Using Text Categorization Method

Chinese Folk Musical Instruments Recognition in Polyphonic Music

Automatic Music Mood Classification by Learning Cross-Media Relevance Between Audio and Lyrics

Calibration of a two-state pitch-wise HMM method for note segmentation in Automatic Music Transcription systems

Feature Analysis for Speech/Music Automatic Classification

Musical Instrument Classification via Low-Dimensional Feature Vectors

Chinese Vowels Recognition Method Based on Non-Homogeneous Hidden Markov Model

A MDCT Domain Feature-Based Approach in Classifying MP3 Song