Abstract:Near-duplicate keyframe (NDK) retrieval techniques are critical to many real-world multimedia applications. Over the last few years, we have witnessed a surge of attention on studying near-duplicate image/keyframe retrieval in the multimedia community. To facilitate an effective approach to NDK retrieval on large-scale data, we suggest an effective Multi-Level Ranking (MLR) scheme that effectively retrieves NDKs in a coarse-to-fine manner. One key stage of the MLR ranking scheme is how to learn an effective ranking function with extremely small training examples in a near-duplicate detection task. To attack this challenge, we employ a semi-supervised learning method, semi-supervised support vector machines, which is able to significantly improve the retrieval performance by exploiting unlabeled data. Another key stage of the MLR scheme is to perform a fine matching among a subset of keyframe candidates retrieved from the previous coarse ranking stage. In contrast to previous approaches based on either simple heuristics or rigid matching models, we propose a novel Nonrigid Image Matching (NIM) approach to tackle near-duplicate keyframe retrieval from real-world video corpora in order to conduct an effective fine matching. Compared with the conventional methods, the proposed NIM approach can recover explicit mapping between two near-duplicate images with a few deformation parameters and find out the correct correspondences from noisy data simultaneously. To evaluate the effectiveness of our proposed approach, we performed extensive experiments on two benchmark testbeds extracted from the TRECVID2003 and TRECVID2004 corpora. The promising results indicate that our proposed method is more effective than other state-of-the-art approaches for near-duplicate keyframe retrieval.

EMD-based video clip retrieval by many-to-many matching

Using Earth Mover'S Distance for Audio Clip Retrieval

Clip-based Similarity Measure for Query-Dependent Clip Retrieval and Video Summarization.

Video Clip Retrieval by Maximal Matching and Optimal Matching in Graph Theory

Clip-based Similarity Measure for Hierarchical Video Retrieval

Near-duplicate Keyframe Retrieval by Nonrigid Image Matching.

OM-based Video Shot Retrieval by One-to-one Matching

An Efficient Method for Video Clip Retrieval Using Equivalence Relation Theory

Query By Video Clip

Clip based video summarization and ranking

Near-duplicate Keyframe Retrieval by Semi-Supervised Learning and Nonrigid Image Matching

A Global Approach for Video Matching

Statistical Modeling and Many-to-many Matching for View-Based 3D Object Retrieval

A New Approach to Retrieve Video by Example Video Clip

An Improved Video Identification Scheme Based on Video Tomography.

An Approach for Shot Retrieval by Optimal Matching in the Bipartite Graph

ECLIPSE: Efficient Long-range Video Retrieval using Sight and Sound

A Fast Video Clip Retrieval Algorithm Based on Va-File

Fast and robust short video clip search using an index structure.

Conditional deep clustering based transformed spatio-temporal features and fused distance for efficient video retrieval

Automatic Identification of Digital Video Based on Shot-Level Sequence Matching.