Abstract:Hashing has been shown to be successful in a number of Approximate Nearest Neighbor (ANN) domains, ranging from medicine, computer vision to information retrieval. However, current deep hashing methods either ignore both rich information of labels and visual linkages of image pairs, or leverage relaxation-based algorithms to address discrete problems, resulting in a large information loss. To address the aforementioned problems, in this paper, we propose an Enhanced Deep Discrete Hashing (EDDH) method to leverage both label embedding and semantic-visual similarity to learn the compact hash codes. In EDDH, the discriminative capability of hash codes is enhanced by a distribution-based continuous semantic-visual similarity matrix, where not only the margin between the positive pairs and negative pairs is expanded, but also the visual linkages between image pairs is considered. Specifically, the semantic-visual continuous similarity matrix is constructed by analyzing the asymmetric generalized Gaussian distribution of the visual linkages between pairs with label consideration. Besides, in order to achieve an efficient hash learning framework, EDDH employs an asymmetric real-valued learning structure to learn the compact hash codes. In addition, we develop a fast discrete optimization algorithm, which can directly generate discrete binary codes in single step, and introduce an intermediate term before iterations to avoid the problems caused by directly the use of large semantic-visual similarity matrix, which results in a significant reduction in the computational overhead. Finally, we conducted extensive experiments on three datasets to show that EDDH has a significantly enhanced performance compared to the compared state-of-the-art baselines.

Integration of Semantic and Visual Hashing for Image Retrieval

Semantic Consistency Hashing for Cross-Modal Retrieval

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Supervised Coarse-to-Fine Semantic Hashing for Cross-Media Retrieval.

Enhanced Deep Discrete Hashing with semantic-visual similarity for image retrieval

Towards Joint Multiply Semantics Hashing For Visual Search

Semantic-consistent cross-modal hashing for large-scale image retrieval

Deep Semantic-Preserving and Ranking-Based Hashing for Image Retrieval.

Dual enhanced semantic hashing for fast image retrieval

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

Semi-Supervised Hashing With Semantic Confidence For Large Scale Visual Search

Deep Multi-Label Hashing For Large-Scale Visual Search Based On Semantic Graph

SSDH: Semi-Supervised Deep Hashing for Large Scale Image Retrieval

A New Ranking Based Semantic Hashing Method for Deep Image Retrieval

Hash Learning with Convolutional Neural Networks for Semantic Based Image Retrieval.

Dual-Level Semantic Transfer Deep Hashing for Efficient Social Image Retrieval

Semantic Binary Coding for Visual Recognition Via Joint Concept-Attribute Modelling.

Deep Supervised Hashing for Fast Image Retrieval

Deep Semantic Reconstruction Hashing for Similarity Retrieval

Deep Visual-Semantic Hashing for Cross-Modal Retrieval

Large-scale Image Retrieval with Sparse Embedded Hashing