Abstract:Recently, video clips have become very popular online. The massive influx of video clips has created an urgent need for video search engines to facilitate retrieving relevant clips. Different from traditional long videos, a video clip is a short video often expressing a moment of significance. Due to the high complexity of video data, efficient video clip search from large databases turns out to be very challenging. We propose a novel video clip representation model called the Bounded Coordinate System (BCS), which is the first single representative capturing the dominating content and content—changing trends of a video clip. It summarizes a video clip by a coordinate system, where each of its coordinate axes is identified by principal component analysis (PCA) and bounded by the range of data projections along the axis. The similarity measure of BCS considers the operations of translation, rotation, and scaling for coordinate system matching. Particularly, rotation and scaling reflect the difference of content tendencies. Compared with the quadratic time complexity of existing methods, the time complexity of measuring BCS similarity is linear. The compact video representation together with its linear similarity measure makes real-time search from video clip collections feasible. To further improve the retrieval efficiency for large video databases, a two-dimensional transformation method called Bidistance Transformation (BDT) is introduced to utilize a pair of optimal reference points with respect to bidirectional axes in BCS. Our extensive performance study on a large database of more than 30,000 video clips demonstrates that BCS achieves very high search accuracy according to human judgment. This indicates that content tendencies are important in determining the meanings of video clips and confirms that BCS can capture the inherent moment of video clip to some extent that better resembles human perception. In addition, BDT outperforms existing indexing methods greatly. Integration of the BCS model and BDT indexing can achieve real-time search from large video clip databases.

A New Index Method for Large Motion Capture Data

A System for Analyzing and Indexing Human-Motion Databases

Performance-Driven Motion Retrieval and its Usability Evaluation

Motion retrieval based on movement notation language: Motion Capture and Retrieval

Motion Retrieval Based On Movement Notation Language

Human Motion Capture Data Retrieval and Segmentation Technology for Professional Sports Training

3D Motion Retrieval with Motion Index Tree

Nonparametric motion model.

Large head movement tracking using sift-based registration.

Bounded Coordinate System Indexing for Real-Time Video Clip Search

A Perceptual User Interface For Motion Retrieval

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

Human motion retrieval based on freehand sketch

Content-Based Analysis and Indexing of Sports Video

Hierarchical indexing scheme for fast search in a large-scale image database

Video Indexing by Motion Activity Maps

Hierarchical Indexing Scheme for Fast Search in Large-Scale Image Database

An Adaptive Index Structure for Similarity Search in Large Image Databases

Efficient Indexing for Large Scale Visual Search

Fast and robust video clip search using index structure.

Scalable Organization of Collections of Motion Capture Data via Quantitative and Qualitative Analysis