Abstract:Query by video clip (QVC) has attracted wide research interests in multimedia information retrieval. In general, QVC may include feature extraction, similarity measure, database organization, and search or query scheme. Towards an effective and efficient solution, diverse applications have different considerations and challenges on the abovementioned phases. In this paper, we firstly attempt to broadly categorize most existing QVC work into 3 levels: concept based video retrieval, video title identification, and video copy detection. This 3-level categorization is expected to explicitly identify typical applications, robust requirements, likely features, and main challenges existing between mature techniques and hard performance requirements. A brief survey is presented to concretize the QVC categorization. Under this categorization, in this paper we focus on the copy detection task, wherein the challenges are mainly due to the design of compact and robust low level features (i.e. an effective signature) and a kind of fast searching mechanism. In order to effectively and robustly characterize the video segments of variable lengths, we design a novel global visual feature (a fixed-size 144-d signature) combining the spatial-temporal and the color range information. Different from previous key frame based shot representation, the ambiguity of key frame selection and the difficulty of detecting gradual shot transition could be avoided. Experiments have shown the signature is also insensitive to color shifting and variations from video compression. As our feature can be extracted directly from MPEG compressed domain, lower computational cost is required. In terms of fast searching, we employ the active search algorithm. Combining the proposed signature and the active search, we have achieved an efficient and robust solution for video copy detection. For example, we can search for a short video clip among the 10.5 hours MPEG-1 video database in merely 2 seconds in the case of unknown query length, and in 0.011 second when fixing the query length as 10 seconds.

Partial Copy Detection in Videos: A Benchmark and an Evaluation of Popular Methods.

Vcdb: A Large-Scale Database for Partial Copy Detection in Videos

Video Copy Detection Method: A Review

An Efficient Partial Video Copy Detection for a Large-scale Video Database

Video Copy Detection Based on Multiple Visual Feature Matching

A Sparse Representation-Based Approach for Video Copy Detection

A content-based video copy detection method with randomly projected binary features.

Video Copy Detection Using a Soft Cascade of Multimodal Features

A Multimodal Video Copy Detection Approach with Sequential Pyramid Matching

Fast and robust short video clip search for copy detection

Video Copy-Detection and Localization with a Scalable Cascading Framework

An Efficient Video Copy Detection Method Based on Video Signature

A Large-scale Comprehensive Dataset and Copy-overlap Aware Evaluation Protocol for Segment-level Video Copy Detection

Video copy detection method based on contents

Content-based copy detection through multimodal feature representation and temporal pyramid matching

Continuous Content-Based Copy Detection over Streaming Videos

The Effects of Short Video-Sharing Services on Video Copy Detection

A Fast Video Copy Detection Approach By Dynamic Programming

A Hierarchical Scheme for Rapid Video Copy Detection

Visual words based spatiotemporal sequence matching in video copy detection

Video Copy Detection Based on Path Merging and Query Content Prediction