Abstract:Our work focuses on tackling large-scale fine-grained image retrieval as ranking the images depicting the concept of interests (i.e., the same sub-category labels) highest based on the fine-grained details in the query. It is desirable to alleviate the challenges of both fine-grained nature of small inter-class variations with large intra-class variations and explosive growth of fine-grained data for such a practical task. In this paper, we propose attribute-aware hashing networks with self-consistency for generating attribute-aware hash codes to not only make the retrieval process efficient, but also establish explicit correspondences between hash codes and visual attributes. Specifically, based on the captured visual representations by attention, we develop an encoder-decoder structure network of a reconstruction task to unsupervisedly distill high-level attribute-specific vectors from the appearance-specific visual representations without attribute annotations. Our models are also equipped with a feature decorrelation constraint upon these attribute vectors to strengthen their representative abilities. Then, driven by preserving original entities' similarity, the required hash codes can be generated from these attribute-specific vectors and thus become attribute-aware. Furthermore, to combat simplicity bias in deep hashing, we consider the model design from the perspective of the self-consistency principle and propose to further enhance models' self-consistency by equipping an additional image reconstruction path. Comprehensive quantitative experiments under diverse empirical settings on six fine-grained retrieval datasets and two generic retrieval datasets show the superiority of our models over competing methods. Moreover, qualitative results demonstrate that not only the obtained hash codes can strongly correspond to certain kinds of crucial properties of fine-grained objects, but also our self-consistency designs can effectively overcome simplicity bias in fine-grained hashing.

ConceptHash: Interpretable Fine-Grained Hashing via Concept Discovery

Supervised Coarse-to-Fine Semantic Hashing for Cross-Media Retrieval.

Kernelised Supervised Context Hashing

Image Retrieval via Balanced and Maximum Variance Deep Hashing.

Piecewise Hashing: A Deep Hashing Method for Large-Scale Fine-Grained Search

Unsupervised Hashing with Semantic Concept Mining

Efficient Fine-Grained Visual-Text Search Using Adversarially-Learned Hash Codes

High-Dimensional Sparse Cross-Modal Hashing with Fine-Grained Similarity Embedding

Fine-Grained Hashing With Double Filtering

Exploring Auxiliary Context: Discrete Semantic Transfer Hashing for Scalable Image Retrieval.

TransHash: Transformer-based Hamming Hashing for Efficient Image Retrieval

Concept Preserving Hashing for Semantic Image Retrieval with Concept Drift.

Inductive Structure Consistent Hashing via Flexible Semantic Calibration

Attribute-Aware Deep Hashing With Self-Consistency for Large-Scale Fine-Grained Image Retrieval

Improved Deep Unsupervised Hashing Via Prototypical Learning

Multi-Granularity Interactive Transformer Hashing for Cross-modal Retrieval

Hyperbolic Hierarchical Contrastive Hashing

Learning Reconfigurable Hashing for Diverse Semantics

Alleviating Over-fitting in Hashing-based Fine-grained Image Retrieval: from Causal Feature Learning to Binary-injected Hash Learning

Self-Adaptive Hashing for Fine-Grained Image Retrieval.

HHF: Hashing-guided Hinge Function for Deep Hashing Retrieval