Abstract:Visual surveillance produces large amounts of video data. Effective indexing and retrieval from surveillance video databases are very important. Although there are many ways to represent the content of video clips in current video retrieval algorithms, there still exists a semantic gap between users and retrieval systems. Visual surveillance systems supply a platform for investigating semantic-based video retrieval. In this paper, a semantic-based video retrieval framework for visual surveillance is proposed. A cluster-based tracking algorithm is developed to acquire motion trajectories. The trajectories are then clustered hierarchically using the spatial and temporal information, to learn activity models. A hierarchical structure of semantic indexing and retrieval of object activities, where each individual activity automatically inherits all the semantic descriptions of the activity model to which it belongs, is proposed for accessing video clips and individual objects at the semantic level. The proposed retrieval framework supports various queries including queries by keywords, multiple object queries, and queries by sketch. For multiple object queries, succession and simultaneity restrictions, together with depth and breadth first orders, are considered. For sketch-based queries, a method for matching trajectories drawn by users to spatial trajectories is proposed. The effectiveness and efficiency of our framework are tested in a crowded traffic scene.

Scene Segmentation and Semantic Representation for High-Level Retrieval

Video scene segmentation and semantic representation using a novel scheme

A Novel Scheme for Video Scenes Segmentation and Semantic Representation

Automatic Scene Detection for Advanced Story Retrieval.

Hierarchical Video Data Modeling and Indexing for Virtual Scene Construction

Video Content Representation for Shot Retrieval and Scene Extraction.

Scene Segmentation Based on Video Structure and Spectral Methods

A Practical Method for Video Scene Segmentation

Non-rigid Video Object Segmentation Based on Semantic Multi-level Framework.

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

An Efficient Approach Based on Image Pixel and Semantic Features Towards Video Retrieval

Semantic Retrieval of Video

Design and Implementation of Semantic Concept Based Video Retrieval System

Video abstraction based on the visual attention model and online clustering

Optimized Video Scene Segmentation.

Semantic-based surveillance video retrieval

Automatic video scene segmentation based on spatial-temporal clues and rhythm

Video Abstraction via Attention Model and On-Line Clustering

Scene-driven Retrieval in Edited Videos using Aesthetic and Semantic Deep Features

A new video retrieval approach based on clustering

Semantic Analysis and Retrieval of Sports Video