Abstract:Our work focuses on tackling large-scale fine-grained image retrieval as ranking the images depicting the concept of interests (i.e., the same sub-category labels) highest based on the fine-grained details in the query. It is desirable to alleviate the challenges of both fine-grained nature of small inter-class variations with large intra-class variations and explosive growth of fine-grained data for such a practical task. In this paper, we propose attribute-aware hashing networks with self-consistency for generating attribute-aware hash codes to not only make the retrieval process efficient, but also establish explicit correspondences between hash codes and visual attributes. Specifically, based on the captured visual representations by attention, we develop an encoder-decoder structure network of a reconstruction task to unsupervisedly distill high-level attribute-specific vectors from the appearance-specific visual representations without attribute annotations. Our models are also equipped with a feature decorrelation constraint upon these attribute vectors to strengthen their representative abilities. Then, driven by preserving original entities' similarity, the required hash codes can be generated from these attribute-specific vectors and thus become attribute-aware. Furthermore, to combat simplicity bias in deep hashing, we consider the model design from the perspective of the self-consistency principle and propose to further enhance models' self-consistency by equipping an additional image reconstruction path. Comprehensive quantitative experiments under diverse empirical settings on six fine-grained retrieval datasets and two generic retrieval datasets show the superiority of our models over competing methods. Moreover, qualitative results demonstrate that not only the obtained hash codes can strongly correspond to certain kinds of crucial properties of fine-grained objects, but also our self-consistency designs can effectively overcome simplicity bias in fine-grained hashing.

A feature consistency driven attention erasing network for fine-grained image retrieval

Large-scale Image Retrieval Based on Boosting Iterative Quantization Hashing with Query-Adaptive Reranking.

Learning Feature Embedding with Strong Neural Activations for Fine-Grained Retrieval

Attribute-Aware Deep Hashing With Self-Consistency for Large-Scale Fine-Grained Image Retrieval

ExchNet: A Unified Hashing Network for Large-Scale Fine-Grained Image Retrieval

A$^2$-Net: Learning Attribute-Aware Hash Codes for Large-Scale Fine-Grained Image Retrieval.

Deep Hash Learning for Remote Sensing Image Retrieval

AE-Net: Fine-grained Sketch-Based Image Retrieval Via Attention-Enhanced Network

Deep Spatial Attention Hashing Network for Image Retrieval.

FFLDGA-Net: Image retrieval method based on Feature Fusion Learnable Descriptor Graph Attention Network

Multi-FusNet: fusion mapping of features for fine-grained image retrieval networks

Coarse-to-Fine: Learning Compact Discriminative Representation for Single-Stage Image Retrieval

FCNet: A Feature Context Network Based on Ensemble Framework for Image Retrieval

Cascading Hierarchical Networks with Multi-task Balanced Loss for Fine-grained hashing

Fine-grained Image Retrieval by Combining Attention Mechanism and Context Information

A Frequency Domain Auxiliary Network for Image Retrieval

Weakly Supervised Image Retrieval via Coarse-scale Feature Fusion and Multi-level Attention Blocks.

Deep Quantization Network for Efficient Image Retrieval

Deep Saliency Hashing

Eliminating Feature Ambiguity for Few-Shot Segmentation