Abstract:Hashing is a common solution for content-based multimedia retrieval by encoding high-dimensional feature vectors into short binary codes. Previous works mainly focus on image hashing problem. However, these methods can not be directly used for video hashing, as videos contain not only spatial structure within each frame, but also temporal correlation between successive frames. Several researchers proposed to handle this by encoding the extracted key frames, but these frame-based methods are time-consuming in real applications. Other researchers proposed to characterize the video by averaging the spatial features of frames and then the existing hashing methods can be adopted. Unfortunately, the sort of “video” features does not take the correlation between frames into consideration and may lead to the loss of the temporal information. Therefore, in this paper, we propose a novel unsupervised video hashing framework via deep neural network, which performs video hashing by incorporating the temporal structure as well as the conventional spatial structure. Specially, the spatial features of videos are obtained by utilizing convolutional neural network, and the temporal features are established via long-short term memory. After that, the time series pooling strategy is employed to obtain the single feature vector for each video. The obtained spatio-temporal feature can be applied to many existing unsupervised hashing methods. Experimental results on two real datasets indicate that by employing the spatio-temporal features, our hashing method significantly improves the performance of existing methods which only deploy the spatial features, and meanwhile obtains higher mean average precision compared with the state-of-the-art video hashing methods.

Self-Supervised Video Hashing with Hierarchical Binary Auto-encoder

Self-Supervised Video Hashing with Hierarchical Binary Auto-Encoder

Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval

Jointly Modeling Static Visual Appearance and Temporal Pattern for Unsupervised Video Hashing.

Unsupervised Deep Video Hashing with Balanced Rotation.

Play and rewind: Optimizing binary representations of videos by self-supervised temporal hashing

Unsupervised Video Hashing by Exploiting Spatio-Temporal Feature

Unsupervised Video Hashing via Deep Neural Network

Self-Supervised Video Hashing Via Bidirectional Transformers.

Unsupervised Variational Video Hashing with 1D-CNN-LSTM Networks.

Self-supervised Temporal Sensitive Hashing for Video Retrieval

CHAIN: Exploring Global-Local Spatio-Temporal Information for Improved Self-Supervised Video Hashing

Unsupervised t-Distributed Video Hashing and its Deep Hashing Extension

A Supervised Video Hashing Method Based on a Deep 3D Convolutional Neural Network for Large-Scale Video Retrieval

Efficient Self-Supervised Video Hashing with Selective State Spaces

Dual-Stream Knowledge-Preserving Hashing for Unsupervised Video Retrieval.

Contrastive Masked Autoencoders for Self-Supervised Video Hashing

Efficient Unsupervised Video Hashing with Contextual Modeling and Structural Controlling

Unsupervised Video Hashing with Multi-granularity Contextualization and Multi-structure Preservation

Attention-based Deep Supervised Hashing for Near Duplicate Video Retrieval

Unsupervised t-Distributed Video Hashing and its Deep Hashing Extension.