Abstract:As the diversity and volume of images continue to grow, the demand for efficient fine-grained image retrieval has surged across numerous fields. However, the current deep learning-based approaches to fine-grained image retrieval often concentrate solely on the top-layer features, neglecting the relevant information carried in the middle layer, even though these information contains more fine-grained identification content. Moreover, these methods typically employ a uniform weighting strategy during hash code mapping, risking the loss of critical region mapping—an irreversible detriment to fine-grained retrieval tasks. To address the above problems, we propose a novel method for fine-grained image retrieval that leverage feature fusion and hash mapping techniques. Our approach harnesses a multi-level feature cascade, emphasizing not just top-layer but also intermediate-layer image features, and integrates a feature fusion module at each level to enhance the extraction of discriminative information. In addition, we introduce an agent self-attention architecture, marking its first application in this context, which steers the model to prioritize on long-range features, further avoiding the loss of critical regions of the mapping. Finally, our proposed model significantly outperforms existing state-of-the-art, improving the retrieval accuracy by an average of 40% for the 12-bit dataset, 22% for the 24-bit dataset, 16% for the 32-bit dataset, and 11% for the 48-bit dataset across five publicly available fine-grained datasets. We also validate the generalization ability and performance stability of our proposed method by another five datasets and statistical significance tests. Our code can be downloaded from https://github.com/BJFU-CS2012/MuiltNet.git.

Multi-Grained Selection and Fusion for Fine-Grained Image Representation

Weighted Multi-feature Fusion Algorithm for Fine-Grained Image Retrieval.

From Coarse to Fine: Multi-Level Feature Fusion Network for Fine-Grained Image Retrieval

Two-stage Fine-Grained Image Classification Model Based on Multi-Granularity Feature Fusion

Feature Re-Attention and Multi-Layer Feature Fusion for Fine-Grained Visual Classification

Multi-feature Fusion for Fine-Grained Sketch-Based Image Retrieval

Fine-grained image recognition via trusted multi-granularity information fusion

Learning Mutually Exclusive Part Representations for Fine-Grained Image Classification

Multi-directional guidance network for fine-grained visual classification

Fine-Grained Visual Classification Via Simultaneously Learning of Multi-regional Multi-grained Features

Fine-Grained Visual Categorization: A Spatial–Frequency Feature Fusion Perspective

Multi-FusNet: fusion mapping of features for fine-grained image retrieval networks

Learning Representation of Multi-Scale Object for Fine-Grained Image Retrieval.

Fine-Grained Image Classification Based on Multi-Scale Feature Fusion

Multi-scale Network Via Progressive Multi-Granularity Attention for Fine-Grained Visual Classification

Multiple Granularity Descriptors for Fine-Grained Categorization.

Coarse-to-Fine Grained Classification

Multi-Grained Contrast for Data-Efficient Unsupervised Representation Learning

Referring Image Segmentation with Fine-Grained Semantic Funneling Infusion

A Multi-View Fusion Method Via Tensor Learning And Gradient Descent For Image Features