Abstract:Our work focuses on tackling large-scale fine-grained image retrieval as ranking the images depicting the concept of interests (i.e., the same sub-category labels) highest based on the fine-grained details in the query. It is desirable to alleviate the challenges of both fine-grained nature of small inter-class variations with large intra-class variations and explosive growth of fine-grained data for such a practical task. In this paper, we propose attribute-aware hashing networks with self-consistency for generating attribute-aware hash codes to not only make the retrieval process efficient, but also establish explicit correspondences between hash codes and visual attributes. Specifically, based on the captured visual representations by attention, we develop an encoder-decoder structure network of a reconstruction task to unsupervisedly distill high-level attribute-specific vectors from the appearance-specific visual representations without attribute annotations. Our models are also equipped with a feature decorrelation constraint upon these attribute vectors to strengthen their representative abilities. Then, driven by preserving original entities' similarity, the required hash codes can be generated from these attribute-specific vectors and thus become attribute-aware. Furthermore, to combat simplicity bias in deep hashing, we consider the model design from the perspective of the self-consistency principle and propose to further enhance models' self-consistency by equipping an additional image reconstruction path. Comprehensive quantitative experiments under diverse empirical settings on six fine-grained retrieval datasets and two generic retrieval datasets show the superiority of our models over competing methods. Moreover, qualitative results demonstrate that not only the obtained hash codes can strongly correspond to certain kinds of crucial properties of fine-grained objects, but also our self-consistency designs can effectively overcome simplicity bias in fine-grained hashing.

Toward Effective Domain Adaptive Retrieval

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

One Network for Multi-Domains: Domain Adaptive Hashing with Intersectant Generative Adversarial Networks.

Domain Adaptation Preconceived Hashing for Unconstrained Visual Retrieval

Supervised Coarse-to-Fine Semantic Hashing for Cross-Media Retrieval.

ROSE: Relational and Prototypical Structure Learning for Universal Domain Adaptive Hashing

DANCE: Learning A Domain Adaptive Framework for Deep Hashing

IDEA: an Invariant Perspective for Efficient Domain Adaptive Image Retrieval

Deep Adaptively-Enhanced Hashing With Discriminative Similarity Guidance for Unsupervised Cross-Modal Retrieval

Deep Self-Adaptive Hashing for Image Retrieval

Transfer Adversarial Hashing for Hamming Space Retrieval

Semantic-Aware Adversarial Training for Reliable Deep Hashing Retrieval

Pseudo-label driven deep hashing for unsupervised cross-modal retrieval

Deep Unsupervised Self-Evolutionary Hashing for Image Retrieval

Unsupervised Semantic-Preserving Adversarial Hashing for Image Search.

Deep Semantic-Alignment Hashing for Unsupervised Cross-Modal Retrieval

Query-Adaptive Image Retrieval by Deep-Weighted Hashing

Attribute-Aware Deep Hashing With Self-Consistency for Large-Scale Fine-Grained Image Retrieval

Scalable Discrete and Asymmetric Unequal Length Hashing Learning for Cross-Modal Retrieval

A High-Dimensional Sparse Hashing Framework for Cross-Modal Retrieval