Abstract:With rapid advances in video processing technologies and ever fast increments in network bandwidth, the popularity of video content publishing and sharing has made similarity search an indispensable operation to retrieve videos of user interests. The video similarity is usually measured by the percentage of similar frames shared by two video sequences, and each frame is typically represented as a high-dimensional feature vector. Unfortunately, high complexity of video content has posed the following major challenges for fast retrieval: (a) effective and compact video representations, (b) efficient similarity measurements, and (c) efficient indexing on the compact representations. In this paper, we propose a number of methods to achieve fast similarity search for very large video database. First, each video sequence is summarized into a small number of clusters, each of which contains similar frames and is represented by a novel compact model called Video Triplet (ViTri). ViTri models a cluster as a tightly bounded hypersphere described by its position, radius, and density. The ViTri similarity is measured by the volume of intersection between two hyperspheres multiplying the minimal density, i.e., the estimated number of similar frames shared by two clusters. The total number of similar frames is then estimated to derive the overall similarity between two video sequences. Hence the time complexity of video similarity measure can be reduced greatly. To further reduce the number of similarity computations on ViTris, we introduce a new one dimensional transformation technique which rotates and shifts the original axis system using PCA in such a way that the original inter-distance between two high-dimensional vectors can be maximally retained after mapping. An efficient B+-tree is then built on the transformed one dimensional values of ViTris' positions. Such a transformation enables B+-tree to achieve its optimal performance by quickly filtering a large portion of non-similar ViTris. Our extensive experiments on real large video datasets prove the effectiveness of our proposals that outperform existing methods significantly.

Incremetal Spatio-Temporal Feature Extraction and Retrieval for Large Video Database

A novel video retrieval algorithm based on spatiotemporal feature

Retrieval Method For Video Content In Different Format Based On Spatiotemporal Features

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

An Efficient Approach Based on Image Pixel and Semantic Features Towards Video Retrieval

Video Identification Using Spatio-temporal Salient Points

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

Semantics-Biased Rapid Retrieval for Video Databases

Video Retrieval with Similarity-Preserving Deep Temporal Hashing

Conditional deep clustering based transformed spatio-temporal features and fused distance for efficient video retrieval

Towards Effective Indexing for Very Large Video Sequence Database

A Video Retrieval Algorithm Based on Spatio-temporal Feature Curves

Large-Scale Video Retrieval Via Deep Local Convolutional Features.

Video Retrieval Algorithm Based on Video Fingerprints and Spatiotemporal Information

Video Retrieval Based on Video Clip

Efficient Similarity Search by Summarization in Large Video Database

Semantic-based surveillance video retrieval

Retrieval in Long Surveillance Videos using User Described Motion and Object Attributes

An Efficient Approach to Content-Based Object Retrieval in Videos.

A Video Content Retrieval Method Based on Spatio-temporal Change Information

Fast and robust video clip search using index structure.