Abstract:With the exponential growth in the production creation of multimedia data, there is an increasing need for video semantic analysis. Audio, as a significant part of video, provides important cues to human perception when humans are browsing and understanding video contents. To detect semantic content by useful audio information, we introduce audio keywords which are sets of specific audio sounds related to semantic events. In our previous work, we designed a hierarchical Support Vector Machine (SVM) classifier for audio keyword identification. However, a weakness of our previous work is that audio signals are artificially segmented into 20 ms frames for frame-based SVM identification without any contextual information. In this paper, we propose a classification method based on Hidden Markov Modal (HMM) for audio keyword identification as an improved work instead of using hierarchical SVM classifier. Choosing HMM is motivated by the successful story of HMM in speech recognition. Unlike the frame-based SVM classification followed by major voting, our proposed HMM-based classifiers treat specific sound as a continuous time series data and employ hidden states transition to capture context information. In particular, we study how to find an effective HMM, i.e., determining topology, observation vectors and statistical parameters of HMM. We also compare different HMM structures with different hidden states, and adjust time series data with variable length. Experimental data includes 40 minutes basketball au-dio which comes from real-time sports games. Experimental results show that, for audio keyword generation, the proposed HMM-based method outperforms the previous hierarchical SVM.

A hybrid scheme for encoding audio signal using hidden Markov models of waveforms

Detection of audio-to-image audio steganography based on peak frequency feature

Data Hiding in Audio Based on Audio-to-Image Wavelet Transform and Vector Quantization

Audio steganalysis method based on wavelet packet and adaptive predictor

AHCM: Adaptive Huffman Code Mapping for Audio Steganography Based on Psychoacoustic Model

Multi-Stage Residual Hiding for Image-into-Audio Steganography.

A Low-throughput Wavelet-based Steganography Audio Scheme

Daubechies Wavelets Based Robust Audio Fingerprinting for Content-Based Audio Retrieval

Hybrid noise shaping for audio coding using perfectly overlapped window

MIDI Audio Steganalysis Via HCF-based Statistical Features

Spectral Analysis for Nonstationary Audio

Active Restoration of Lost Audio Signals Using Machine Learning and Latent Information

An Audio Compression Algorithm Using a Wavelet Packet Transform

A Novel Audio Watermarking Scheme Using Multiscale Wavelet Modulation

Steganography Integration Into a Low-Bit Rate Speech Codec

Audio Time-Scale Modification with Temporal Compressing Networks

HMM-Based Audio Keyword Generation

A Modified Multi-resolutional LSB Insertion Algorithm for High Capacity Audio Steganography

A Blind Audio Steganalysis Based on Feature Fusion

Investigation on the use of Hidden-Markov Models in automatic transcription of music

An Audio Copyright Protection Schemes Based On Smm In Cepstrum Domain