Abstract:In recent years, there has been an explosive increase in the amount of existing visual data. Hashing techniques have been successfully applied to deal with the large-scale nearest neighbor search problem among data on this massive scale. However, existing hashing methods usually learn a single hash code for each data point, and only by taking the content correlations among them into account. In practice, however, when handling complex visual data such as video, strong temporal relations exist among the successive frames. Moreover, if the preferred performance for large-scale video search is to be delivered, multiple hash codes are required for each data point in order to build multiple hash table indices. To address these problems, in this paper, we first study the multi-table learning problem for video search and attempt to learn binary codes by capturing the intrinsic video similarities from both the visual and the temporal aspects. By regarding the search over multiple tables as an ensemble prediction, the whole multi-table learning problem can be solved in a boosting learning manner to complementarily cover the nearest neighbors. For each table, a temporal binary coding solution is devised that thinks over the intrinsic relations among the visual content and the temporal consistency among the successive frames simultaneously. More specifically, we approximate the intrinsic visual similarities using a low-rank matrix based on sparse, non-negative feature expression. Furthermore, to essentially preserve the temporal consistency, we introduce a subspace rotation to model the variation among the successive frames. Under the boosting learning framework, the binary codes, hash functions and temporal variation of each table can be efficiently and jointly optimized. Extensive experiments on three large video datasets demonstrate that the proposed approach significantly outperforms a number of state-of-the-art hashing methods.

Boosting Temporal Binary Coding for Large-Scale Video Search

Video Retrieval with Similarity-Preserving Deep Temporal Hashing

Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval

Classification-enhancement Deep Hashing for Large-Scale Video Retrieval.

Nonlinear Structural Hashing for Scalable Video Search.

Self-Supervised Video Hashing with Hierarchical Binary Auto-Encoder

Scalable Video Event Retrieval by Visual State Binary Embedding.

Discriminative Codebook Hashing for Supervised Video Retrieval

Unsupervised Video Hashing by Exploiting Spatio-Temporal Feature

Large-Scale Video Hashing Via Structure Learning

Attention-Based Video Hashing for Large-Scale Video Retrieval

Jointly Modeling Static Visual Appearance and Temporal Pattern for Unsupervised Video Hashing.

Submodular video hashing

Joint Multi-View Hashing for Large-Scale Near-Duplicate Video Retrieval

CHAIN: Exploring Global-Local Spatio-Temporal Information for Improved Self-Supervised Video Hashing

Deep Binaries: Encoding Semantic-Rich Cues for Efficient Textual-Visual Cross Retrieval

A Supervised Video Hashing Method Based on a Deep 3D Convolutional Neural Network for Large-Scale Video Retrieval

Encode the Unseen: Predictive Video Hashing for Scalable Mid-Stream Retrieval

Efficient Binary Coding for Subspace-based Query-by-Image Video Retrieval

DLSTM Approach to Video Modeling with Hashing for Large-Scale Video Retrieval

Efficient Supervised Discrete Multi-View Hashing for Large-Scale Multimedia Search