Abstract:Recently, with the popularization of camera tools such as mobile phones and the rise of various short video platforms, a lot of videos are being uploaded to the Internet at all times, for which a video retrieval system with fast retrieval speed and high precision is very necessary. Therefore, content-based video retrieval (CBVR) has aroused the interest of many researchers. A typical CBVR system mainly contains the following two essential parts: video feature extraction and similarity comparison. Feature extraction of video is very challenging, previous video retrieval methods are mostly based on extracting features from single video frames, while resulting the loss of temporal information in the videos. Hashing methods are extensively used in multimedia information retrieval due to its retrieval efficiency, but most of them are currently only applied to image retrieval. In order to solve these problems in video retrieval, we build an end-to-end framework called deep supervised video hashing (DSVH), which employs a 3D convolutional neural network (CNN) to obtain spatial-temporal features of videos, then train a set of hash functions by supervised hashing to transfer the video features into binary space and get the compact binary codes of videos. Finally, we use triplet loss for network training. We conduct a lot of experiments on three public video datasets UCF-101, JHMDB and HMDB-51, and the results show that the proposed method has advantages over many state-of-the-art video retrieval methods. Compared with the DVH method, the mAP value of UCF-101 dataset is improved by 9.3%, and the minimum improvement on JHMDB dataset is also increased by 0.3%. At the same time, we also demonstrate the stability of the algorithm in the HMDB-51 dataset.

Deep Learning Based Semantic Video Indexing and Retrieval

Learning Feature Embedding with Strong Neural Activations for Fine-Grained Retrieval

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

DeepSeek: Content Based Image Search & Retrieval

Video diver: generic video indexing with diverse features.

A multimodal deep learning framework for scalable content based visual media retrieval

Scalable Multimedia Retrieval By Deep Learning Hashing With Relative Similarity Learning

Semantic-based surveillance video retrieval

An Efficient Approach Based on Image Pixel and Semantic Features Towards Video Retrieval

The VISIONE Video Search System: Exploiting Off-the-Shelf Text Search Engines for Large-Scale Video Retrieval

Robust Semantic Video Indexing by Harvesting Web Images.

Fast And Accurate Content-Based Semantic Search In 100m Internet Videos

An Interactive Video Search Platform for Multi-modal Retrieval with Advanced Concepts

Video indexing and retrieval in compressed domain using fuzzy-categorization

A Supervised Video Hashing Method Based on a Deep 3D Convolutional Neural Network for Large-Scale Video Retrieval

Use What You Have: Video Retrieval Using Representations from Collaborative Experts.

Remote Sensing Image Retrieval with Deep Features Encoding of Inception V4 and Largevis Dimensionality Reduction

On-demand Information Retrieval from Videos Using Deep Learning in Wireless Networks: Demo Abstract.

Semantic Feature Mining for Video Event Understanding.

Semantic Video Search by Exploiting Large-Scale Visual Concepts

Deep Learning for Instance Retrieval: A Survey