Abstract:As the diversity and volume of images continue to grow, the demand for efficient fine-grained image retrieval has surged across numerous fields. However, the current deep learning-based approaches to fine-grained image retrieval often concentrate solely on the top-layer features, neglecting the relevant information carried in the middle layer, even though these information contains more fine-grained identification content. Moreover, these methods typically employ a uniform weighting strategy during hash code mapping, risking the loss of critical region mapping—an irreversible detriment to fine-grained retrieval tasks. To address the above problems, we propose a novel method for fine-grained image retrieval that leverage feature fusion and hash mapping techniques. Our approach harnesses a multi-level feature cascade, emphasizing not just top-layer but also intermediate-layer image features, and integrates a feature fusion module at each level to enhance the extraction of discriminative information. In addition, we introduce an agent self-attention architecture, marking its first application in this context, which steers the model to prioritize on long-range features, further avoiding the loss of critical regions of the mapping. Finally, our proposed model significantly outperforms existing state-of-the-art, improving the retrieval accuracy by an average of 40% for the 12-bit dataset, 22% for the 24-bit dataset, 16% for the 32-bit dataset, and 11% for the 48-bit dataset across five publicly available fine-grained datasets. We also validate the generalization ability and performance stability of our proposed method by another five datasets and statistical significance tests. Our code can be downloaded from https://github.com/BJFU-CS2012/MuiltNet.git.

Weakly Supervised Image Retrieval via Coarse-scale Feature Fusion and Multi-level Attention Blocks.

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Learning Feature Embedding with Strong Neural Activations for Fine-Grained Retrieval

AE-Net: Fine-grained Sketch-Based Image Retrieval Via Attention-Enhanced Network

A feature consistency driven attention erasing network for fine-grained image retrieval

End-to-end Semantic-Aware Object Retrieval Based on Region-Wise Attention

Deep Spatial Attention Hashing Network for Image Retrieval.

Feature Fusion for Image Retrieval with Adaptive Bitrate Allocation and Hard Negative Mining.

Coarse-to-Fine: Learning Compact Discriminative Representation for Single-Stage Image Retrieval

Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism

Fine-grained Image Retrieval by Combining Attention Mechanism and Context Information

Coarse-to-fine dual-level attention for video-text cross modal retrieval

A novel attention-enhanced network for image super-resolution

Multi-FusNet: fusion mapping of features for fine-grained image retrieval networks

Semi-Heterogeneous Three-Way Joint Embedding Network for Sketch-Based Image Retrieval

Learning Deep Local Features with Multiple Dynamic Attentions for Large-Scale Image Retrieval.

FB-Net: Dual-Branch Foreground-Background Fusion Network With Multi-Scale Semantic Scanning for Image-Text Retrieval

FFLDGA-Net: Image retrieval method based on Feature Fusion Learnable Descriptor Graph Attention Network

Attention based dual UNET network for infrared and visible image fusion

Image Retrieval Based on Multi-feature Fusion of Color Connected Region

Object-Based Image Retrieval With Attention Analysis And Spatial Re-Ranking