Abstract:Video semantic analysis is essential in video indexing and structuring. However, due to the lack of robust and generic algorithms, most of the existing works on semantic analysis are limited to specific domains. In this paper, we present a novel hidden Markove model (HMM)-based framework as a general solution to video semantic analysis. In the proposed framework, semantics in different granularities are mapped to a hierarchical model space, which is composed of detectors and connectors. In this manner, our model decomposes a complex analysis problem into simpler subproblems during the training process and automatically integrates those subproblems for recognition. The proposed framework is not only suitable for a broad range of applications, but also capable of modeling semantics in different semantic granularities. Additionally, we also present a new motion representation scheme, which is robust to different motion vector sources. The applications of the proposed framework in basketball event detection, soccer shot classification, and volleyball sequence analysis have demonstrated the effectiveness of the proposed framework on video semantic analysis.

Video Sequences Foreground Enhancement Using Hidden Markov Model

Vibration-resisted video segmentation algorithm based on hierarchical Markov random field model

Adaptive Foreground and Shadow Segmentation Using Hidden Conditional Random Fields

Adaptive Video Segmentation Algorithm Using Hidden Conditional Random Fields

A New Approach for Real-Time Segmenting Moving Objects under Cluttered Background

New Method Of Background Update For Video-Based Vehicle Detection

RVM-based classification of the network video surveillance system

Video Based Head Detection and Tracking Surveillance System

A Double-Layer Model for Foreground Detection from Video Sequence

Multi-Channel Adaptive Mixture Background Model for Real-time Tracking.

An Effective Method for Foreground Segmentation of Video

Efficient video object segmentation based on Gaussian mixture model and Markov random field

Vision-Based Moving Objects Detection with Background Modeling

Motion-Based Background Subtraction

MRF-based Adaptive Approach for Foreground Segmentation under Sudden Illumination Change

Foreground detection in video sequences with probabilistic self-organizing maps

An HMM-based framework for video semantic analysis

Efficient Background Model Based on Multi-Level Feedback for Video Surveillance

Foreground Object Detecting Algorithm Based On Mixture Of Gaussian And Kalman Filter In Video Surveillance

Dynamic Background Estimation and Complementary Learning for Pixel-Wise Foreground/background Segmentation

Spatial-based Bayesian Hidden Markov Models with Dirichlet Mixtures for Video Anomaly Detection