Abstract:With the explosive growth of surveillance videos, object retrieval has become a significant task for security monitoring. However, visual objects in surveillance videos are usually of small size with complex light conditions, view changes and partial occlusions, which increases the difficulty level of efficiently retrieving objects of interest in a large-scale dataset. Although deep features have achieved promising results on object classification and retrieval and have been verified to contain rich semantic structure property, they lack of adequate color information, which is as crucial as structure information for effective object representation. In this paper, we propose to leverage discriminative Convolutional Neural Network (CNN) to learn deep structure and color feature to form an efficient multi-view object representation. Specifically, we utilize CNN trained on ImageNet to abstract rich semantic structure information. Meanwhile, we propose a CNN model supervised by 11 color names to extract deep color features. Compared with traditional color descriptors, deep color features can capture the common color property across different illumination conditions. Then, the complementary multi-view deep features are encoded into short binary codes by Locality-Sensitive Hash (LSH) and fused to retrieve objects. Retrieval experiments are performed on a dataset of 100k objects extracted from multi-camera surveillance videos. Comparison results with several popular visual descriptors show the effectiveness of the proposed approach.

Deep Learning-Based Multi-Object Association Retrieval

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Effective Deep Learning-Based Multi-Modal Retrieval

Deep Multiple Instance Hashing for Fast Multi-Object Image Search

Multi-View 3d Object Retrieval with Deep Embedding Network

Deep Multiple Instance Hashing for Object-based Image Retrieval.

An Object-Level Feature Representation Model for the Multi-target Retrieval of Remote Sensing Images.

Domain-Specific Alignment Network for Multi-Domain Image-Based 3D Object Retrieval

Image Retrieval Based on Multi-Concept Detector and Semantic Correlation.

Multi-Modal Retrieval Via Deep Textual-Visual Correlation Learning

Multi-scale remote sensing image retrieval based on deep learning and complex spatial relation

Hybrid Deep Neural Network-Based Cross-Modal Image and Text Retrieval Method for Large-Scale Data.

Augmented Image Retrieval Using Multi-Order Object Layout With Attributes

Multiple Discrimination and Pairwise CNN for view-based 3D object retrieval

Hybrid Associative Retrieval of Three-Dimensional Models.

Deep Residual Net Based Compact Feature Representation for Image Retrieval.

Joint Deep Hashing and Object Detection for Image Retrieval.

Semantic Association Based Image Retrieve and Image Index

Multi-View Object Retrieval Via Multi-Scale Topic Models.

3D Shape Recognition and Retrieval Based on Multi-Modality Deep Learning

Learning Multi-View Deep Features For Small Object Retrieval In Surveillance Scenarios