Abstract:As video databases become increasingly important for full exploitation of multimedia resources, this paper aims at describing our recent efforts in feasibility studies towards building up a content-based and high-level video retrieval/management system. The study is focused on constructing a semantic tree structure via combination of low-level image processing techniques and high-level interpretation of visual content. Specifically, two separate algorithms were developed to organise input videos in terms of two layers: the shot layer and the key-frame layer. While the shot layer is derived by developing a multi-featured shot cut detection, the key frame layer is extracted automatically by a genetic algorithm. This paves the way for applying pattern recognition techniques to analyse those key frames and thus extract high level information to interpret the visual content or objects. Correspondingly, content-based video retrieval can be conducted in three stages. The first stage is to browse the digital video via the semantic tree at structural level, the second stage is match the key frame in terms of low-level features, such as colour, shape of objects, and texture etc. Finally, the third stage is to match the high-level information, such as conversation with indoor background, moving vehicles along a seaside road etc. Extensive experiments are reported in this paper for shot cut detection and key frame extraction, enabling the tree structure to be constructed.

Searching for Flash Movies on the Web: A Content and Context Based Framework

Search for Flash Movies on the Web

Content-based Retrieval of Flash™ Movies: Research Issues, Generic Framework, and Future Directions

FLAME : A Generic Framework for Content-based Flash Retrieval

On Retrieval of Flash Animations Based on Visual Features

Exploiting Multi-Category Characteristics and Unified Framework to Extract Web Content

Sketch-based Retrieval on Flash Movies Via Primary Scene.

A Grid-Based Framework For Pervasive Cross-Media Retrieval

Design and Implementation of a Context-Based Media Retrieval System

A Flexible and Extensible Framework for Web Image Retrieval System

Efficient Access to Video Content in a Unified Framework

A Hierarchical Framework For Movie Content Analysis: Let Computers Watch Films Like Humans

Framework of content-based multimedia retrieval for digital library

Interactive Web Video Advertising with Context Analysis and Search

A Unified Framework for Video Summarization, Browsing, and Retrieval

A Conversational Movie Search System Based on Conditional Random Fields

Multimedia information retrieval at a crossroad

A MULTI-CHANNEL RETRIEVAL SYSTEM FOR MULTIMEDIA DOCUMENTS

A Tree-Based Paradigm for Content-Based Video Retrieval and Management

Content-Based Video Search: Is there a Need, and Is it Possible?

A Content-Based Distributed FTP Search Engine:Design and Implementation