Abstract:With the exponential growth in the production creation of multimedia data, there is an increasing need for video semantic analysis. Audio, as a significant part of video, provides important cues to human perception when humans are browsing and understanding video contents. To detect semantic content by useful audio information, we introduce audio keywords which are sets of specific audio sounds related to semantic events. In our previous work, we designed a hierarchical Support Vector Machine (SVM) classifier for audio keyword identification. However, a weakness of our previous work is that audio signals are artificially segmented into 20 ms frames for frame-based SVM identification without any contextual information. In this paper, we propose a classification method based on Hidden Markov Modal (HMM) for audio keyword identification as an improved work instead of using hierarchical SVM classifier. Choosing HMM is motivated by the successful story of HMM in speech recognition. Unlike the frame-based SVM classification followed by major voting, our proposed HMM-based classifiers treat specific sound as a continuous time series data and employ hidden states transition to capture context information. In particular, we study how to find an effective HMM, i.e., determining topology, observation vectors and statistical parameters of HMM. We also compare different HMM structures with different hidden states, and adjust time series data with variable length. Experimental data includes 40 minutes basketball au-dio which comes from real-time sports games. Experimental results show that, for audio keyword generation, the proposed HMM-based method outperforms the previous hierarchical SVM.

A Method Based on General Model and Rough Set for Audio Classification

Hybrid Independent Component Analysis and Rough Set Approach for Audio Feature Extraction

An Approach Based on Reverse Hidden Markov Model for Audio Classification

Hybrid Support Vector Machine and General Model Approach for Audio Classification

A Method Based On General Model Template For Audio Retrieval

Audio Analysis Approach based on General Model

Hybrid Svm/Hmm Approach For Audio Classification

Audio Sentiment Analysis by Heterogeneous Signal Features Learned from Utterance-Based Parallel Neural Network.

Hybrid Independent Component Analysis And Support Vector Machine Approach For Audio Classification

Hierarchical Support Vector Machines for Audio Classification

Audio classification based on maximum entropy model

On Feature Combination For Music Classification

Semi-supervised Minimum Redundancy Maximum Relevance Feature Selection for Audio Classification

Robust Audio Sensing with Multi-Sound Classification.

Music Classification Via the Bag-of-features Approach.

Feature Analysis for Speech/Music Automatic Classification

SemanticAC: Semantics-Assisted Framework for Audio Classification

Semi-supervised Feature Selection for Audio Classification Based on Constraint Compensated Laplacian Score

A Music Classification Model based on Metric Learning and Feature Extraction from MP3 Audio Files

A Novel Classification-Based Audio Segmentation Algorithm

HMM-Based Audio Keyword Generation