Abstract:In real-world datasets, visually related images often form clusters, and these clusters can be further grouped into larger categories with more general semantics. These inherent hierarchical structures can help capture the underlying distribution of data, making it easier to learn robust hash codes that lead to better retrieval performance. However, existing methods fail to make use of this hierarchical information, which in turn prevents the accurate preservation of relationships between data points in the learned hash codes, resulting in suboptimal performance. In this paper, our focus is on applying visual hierarchical information to self-supervised hash learning and addressing three key challenges, including the construction, embedding, and exploitation of visual hierarchies. We propose a new self-supervised hashing method named Hierarchical Hyperbolic Contrastive Hashing (HHCH), making breakthroughs in three aspects. First, we propose to embed continuous hash codes into hyperbolic space for accurate semantic expression since embedding hierarchies in the hyperbolic space generates less distortion than in the hyper-sphere or Euclidean space. Second, we update the K-Means algorithm to make it run in the hyperbolic space. The proposed hierarchical hyperbolic K-Means algorithm can achieve the adaptive construction of hierarchical semantic structures. Last but not least, to exploit the hierarchical semantic structures in hyperbolic space, we propose the hierarchical contrastive learning algorithm, including hierarchical instance-wise and hierarchical prototype-wise contrastive learning. Extensive experiments on four benchmark datasets demonstrate that the proposed method outperforms state-of-the-art self-supervised hashing methods. Our codes are released at https://github.com/HUST-IDSM-AI/HHCH.git.

Hierarchical Hashing for Image Retrieval.

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Hierarchical Deep Semantic Hashing for Fast Image Retrieval

Multiple Hierarchical Deep Hashing for Large Scale Image Retrieval

Hierarchical Recurrent Neural Hashing for Image Retrieval with Hierarchical Convolutional Features

Image Retrieval via Balanced and Maximum Variance Deep Hashing.

Hierarchical Deep Hashing for Fast Large Scale Image Retrieval

Deep Semantic-Preserving and Ranking-Based Hashing for Image Retrieval.

Exploring Hierarchical Information in Hyperbolic Space for Self-Supervised Image Hashing

Supervised Deep Hashing for Hierarchical Labeled Data

SSDH: Semi-Supervised Deep Hashing for Large Scale Image Retrieval

Deep Supervised Hashing by Classification for Image Retrieval

Hierarchical Hashing Learning for Image Set Classification

Hierarchical Deep Hashing for Image Retrieval

Deep Progressive Hashing for Image Retrieval

Deep Self-Adaptive Hashing for Image Retrieval

Supervised Hierarchical Deep Hashing for Cross-Modal Retrieval

Large-scale Image Retrieval with Supervised Sparse Hashing

Rank-embedded Hashing for Large-scale Image Retrieval

Deep Multi-Label Hashing For Large-Scale Visual Search Based On Semantic Graph

Multi-level Supervised Hashing with Deep Features for Efficient Image Retrieval