Abstract:With the exponential growth in the production creation of multimedia data, there is an increasing need for video semantic analysis. Audio, as a significant part of video, provides important cues to human perception when humans are browsing and understanding video contents. To detect semantic content by useful audio information, we introduce audio keywords which are sets of specific audio sounds related to semantic events. In our previous work, we designed a hierarchical Support Vector Machine (SVM) classifier for audio keyword identification. However, a weakness of our previous work is that audio signals are artificially segmented into 20 ms frames for frame-based SVM identification without any contextual information. In this paper, we propose a classification method based on Hidden Markov Modal (HMM) for audio keyword identification as an improved work instead of using hierarchical SVM classifier. Choosing HMM is motivated by the successful story of HMM in speech recognition. Unlike the frame-based SVM classification followed by major voting, our proposed HMM-based classifiers treat specific sound as a continuous time series data and employ hidden states transition to capture context information. In particular, we study how to find an effective HMM, i.e., determining topology, observation vectors and statistical parameters of HMM. We also compare different HMM structures with different hidden states, and adjust time series data with variable length. Experimental data includes 40 minutes basketball au-dio which comes from real-time sports games. Experimental results show that, for audio keyword generation, the proposed HMM-based method outperforms the previous hierarchical SVM.

Application of DHMM to mechanical equipment audio recognition

Recording Device Identification Based on Cepstral Mixed Features

Fault Diagnosis Method Based on Improved Deep Boltzmann Machines

HMM training method based on evolutionary computation and MDI in speech recognition

The Pattern Recognition of Non-Destructive Testing Based on HMM

Real-time FDM Machine Condition Monitoring and Diagnosis Based on Acoustic Emission and Hidden Semi-Markov Model

In situ monitoring of FDM machine condition via acoustic emission

2D-HMM BASED CHARACTER RECOGNITION OF THE ENGINEERING DRAWING

Automatic evaluation method for vehicle audio warning system using MFCC-polynomial hybrid feature

Hybrid Svm/Hmm Approach For Audio Classification

A method of fault alarm recognition based on hidden Markov model

Sub-Health Identification of Reciprocating Machinery Based on Sound Feature and OOD Detection

HMM-Based Audio Keyword Generation

Application of HSMM on NC machine's state recognition

Hidden Markov Models based intelligent health assessment and fault diagnosis of rolling element bearings

New Approach to Classification of Chinese Folk Music Based on Extension of HMM

A survey of mechanical fault diagnosis based on audio signal analysis

Chinese Vowels Recognition Method Based on Non-Homogeneous Hidden Markov Model

Digital Speech Recognition Based on DDBHMM

HMM Modeling Based on Mandarin Phonemes in Embedded Systems

Construction of Multi-Features Comprehensive Indicator for Machinery Health State Assessment