Abstract:Fine-grained image recognition is challenging because discriminative clues are usually fragmented, whether from a single image or multiple images. Despite their significant improvements, the majority of existing methods still focus on the most discriminative parts from a single image, ignoring informative details in other regions and lacking consideration of clues from other associated images. In this paper, we analyze the difficulties of fine-grained image recognition from a new perspective and propose a transformer architecture with the peak suppression module and knowledge guidance module, which respects the diversification of discriminative features in a single image and the aggregation of discriminative clues among multiple images. Specifically, the peak suppression module first utilizes a linear projection to convert the input image into sequential tokens. It then blocks the token based on the attention response generated by the transformer encoder. This module penalizes the attention to the most discriminative parts in the feature learning process, therefore, enhancing the information exploitation of the neglected regions. The knowledge guidance module compares the image-based representation generated from the peak suppression module with the learnable knowledge embedding set to obtain the knowledge response coefficients. Afterwards, it formalizes the knowledge learning as a classification problem using response coefficients as the classification scores. Knowledge embeddings and image-based representations are updated during training simultaneously so that the knowledge embedding includes a large number of discriminative clues for different images of the same category. Finally, we incorporate the acquired knowledge embeddings into the image-based representations as comprehensive representations, leading to significantly higher recognition performance. Extensive evaluations on the six popular datasets demonstrate the advantage of the proposed method in performance. The source code and models will be available online after the acceptance of the paper.

Fine-grained image recognition method for digital media based on feature enhancement strategy

Learning Enhanced Features and Inferring Twice for Fine-Grained Image Classification

Fine-grained Image Analysis Via Progressive Feature Learning

Deep Learning for Fine-Grained Image Recognition: A Comprehensive Study

Application of Improved DNN Algorithm Based on Feature Fusion in Fine-Grained Image Recognition

Discriminative Feature Mining and Enhancement Network for Low-resolution Fine-grained Image Recognition

Fine-Grained Image Recognition Methods and Their Applications in Remote Sensing Images: A Review

From Coarse to Fine: Multi-Level Feature Fusion Network for Fine-Grained Image Retrieval

Research on Fine-Grained Image Recognition Based on Foreground Extraction and Convolutional Neural Networks

From the whole to detail: Progressively sampling discriminative parts for fine-grained recognition

Fine-Grained Image Analysis With Deep Learning: A Survey

Fine-Grained Feature Enhancement for Object Detection in Remote Sensing Images

Learning Discriminative Features for Fine-grained Image Retrieval

Learning Relation-Based Features for Fine-Grained Image Retrieval

Discriminative Information Restoration and Extraction for Weakly Supervised Low-Resolution Fine-Grained Image Recognition

Fine-grained image classification method based on hybrid attention module

Learning Attention-Guided Pyramidal Features for Few-Shot Fine-Grained Recognition.

Transformer with peak suppression and knowledge guidance for fine-grained image recognition

A data-driven study of image feature extraction and fusion

Hybrid Granularities Transformer for Fine-Grained Image Recognition

An Efficient Fine-Grained Vehicle Recognition Method Based on Part-Level Feature Optimization