Abstract:Fine-grained image categorization is a challenging task due to the difficulty of localizing the discriminative regions for different sub-categories. Previous works mainly focus on using the manual annotations or the attention algorithm to localize these regions, which is demanding and complex in practical applications. This paper proposes a method of using a multi-level attention model (MLA-CNN) which has been trained on the full-size image train set of current tasks to localize the most discriminative regions. Intuitively, three typical receptive field sizes are selected for the multi-level attention maps. Then, multi-level dictionary learning is introduced to extract discriminative features from these localized regions. Our method explores a new thought about how to use the neural activations to generate multi-scale regions which are helpful for the fine-grained categorization. The method can be achieved in two steps. The first step is to select the neurons that have the max activation in the selected three feature maps. These feature maps are the outputs of the pre-trained CNN model by feeding the full-size images into the model. Then, we generate the discriminative regions according to the receptive field size of the selected neurons. The second step is to train the subtle networks with these multi-scale regions. One scaled discriminative region can be regarded as one typical dictionary feature. Then these results are integrated for final prediction. We evaluate our method on three challenging fine-grained image datasets, CUB-200-2011, Stanford Dogs, and Stanford Cars. The experimental results demonstrate that our method outperforms many state-of-the-art methods, using extra object/parts annotations and attention-based methods.

Learning Rich Part Hierarchies with Progressive Attention Networks for Fine-Grained Image Recognition

Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition

A Multi-part Convolutional Attention Network for Fine-Grained Image Recognition

Attention cutting and padding learning for fine-grained image recognition

Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-Grained Image Recognition

Learning Scale-Consistent Attention Part Network for Fine-grained Image Recognition

Learning Hierarchal Channel Attention for Fine-grained Visual Classification.

Fully Convolutional Attention Networks for Fine-Grained Recognition

Hierarchical Gate Network for Fine-Grained Visual Recognition.

From the whole to detail: Progressively sampling discriminative parts for fine-grained recognition

Part Attentioned Fine-Grained Categorization Using Context Sensitive Flow

Fine-Grained Recognition as HSnet Search for Informative Image Parts

Cross-Part Learning for Fine-Grained Image Classification

Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-Grained Image Recognition

Learning Two-level Features for Fine-grained Image Classification

Real Time Fine-Grained Categorization with Accuracy and Interpretability.

Multi-level Dictionary Learning for Fine-Grained Images Categorization with Attention Model

Multi-Attention Multi-Class Constraint for Fine-grained Image Recognition

Fine-Grained Image Classification with Object-Part Model

Progressive Co-Attention Network for Fine-grained Visual Classification.

Fine-Grained Imag E Categorization by Localizing Tiny Object Parts from Unannotated Images