Abstract:With the exponential growth in the production creation of multimedia data, there is an increasing need for video semantic analysis. Audio, as a significant part of video, provides important cues to human perception when humans are browsing and understanding video contents. To detect semantic content by useful audio information, we introduce audio keywords which are sets of specific audio sounds related to semantic events. In our previous work, we designed a hierarchical Support Vector Machine (SVM) classifier for audio keyword identification. However, a weakness of our previous work is that audio signals are artificially segmented into 20 ms frames for frame-based SVM identification without any contextual information. In this paper, we propose a classification method based on Hidden Markov Modal (HMM) for audio keyword identification as an improved work instead of using hierarchical SVM classifier. Choosing HMM is motivated by the successful story of HMM in speech recognition. Unlike the frame-based SVM classification followed by major voting, our proposed HMM-based classifiers treat specific sound as a continuous time series data and employ hidden states transition to capture context information. In particular, we study how to find an effective HMM, i.e., determining topology, observation vectors and statistical parameters of HMM. We also compare different HMM structures with different hidden states, and adjust time series data with variable length. Experimental data includes 40 minutes basketball au-dio which comes from real-time sports games. Experimental results show that, for audio keyword generation, the proposed HMM-based method outperforms the previous hierarchical SVM.

GMM Based Intelligent Detection of the Vocal Segment in Popular Music

Applying Support Vector Machines to Voice Activity Detection

An Effective Vocal/Non-vocal Segmentation Approach for Embedded Music Retrieve System on Mobile Phone

Automatic Audio Classification Based on EMGD_HMM

Long Short-Term Memory-Based Music Analysis System for Music Therapy

Comparison for Improvements of Singing Voice Detection System Based on Vocal Separation

A Novel Singer Identification Method Using GMM-UBM

A SVM-Based Audio Event Detection System

Research on the Whole Teaching of Vocal Music Course in University Music Performance Major Based on Multimedia Technology

Using Dtw Based Unsupervised Segmentation To Improve The Vocal Part Detection In Pop Music

New Approach to Classification of Chinese Folk Music Based on Extension of HMM

Vocal discrimination in pop music based on SVM

[Research on Biometric Method of Heart Sound Signal Based on GMM].

The rise of big data on the development of music education and innovation to promote

Automatic Singer Identification Using Missing Feature Methods

HMM-Based Audio Keyword Generation

Singer identification based on computational auditory scene analysis and missing feature methods

A Practical Singing Voice Detection System Based on GRU-RNN

Singing Melody Extraction from Pop Songs Using a Novel Feature and Viterbi Search

An automatic language identification method based on subspace analysis