Abstract:Due to the existence of attention system, people pay attention to the distinguishable area of the image, rather than directly receiving and processing the information of the whole image. This natural advantage makes attention mechanism widely used in fine-grained image classification. The research goal of fine-grained image classification task often is to differentiate subclass objects belonging to the same basic category. The difficulty of classification is that there are only slight local differences between different categories, but there may be large feature differences within the same category. At the same time, complex background features also bring interference factors to image recognition. In order to further extract discriminant regional features, this paper proposes a fine-grained image classification method WSFF-BCNN based on weak supervision feature fusion from two aspects: the improvement of the loss function in the training process of convolution neural network and the refinement of fine-grained image feature extraction. It uses the mixed attention of channel domain and spatial domain to obtain the detailed description information in the feature to highlight the response of the corresponding channel and spatial location in the feature map and pay attention to the attention characteristics of different dimensions. The original images of different sizes are input into the improved bilinear model to obtain multi-scale features. The large-scale features can represent the spatial location information of key areas, and the small-scale features represent the low-level features of the image. The backbone network of bilinear network uses ResNet50 to extract features and sample and zoom and uses bilinear pooling to fuse features of different scales to obtain a rich image feature representation.

Attention Bilinear Pooling for Fine-Grained Classification

Fine-grained Visual Classification Via Multilayer Bilinear Pooling with Object Localization

Adaptive Bilinear Pooling for Fine-grained Representation Learning.

A Fine-Grained Image Classification and Detection Method Based on Convolutional Neural Network Fused with Attention Mechanism

Improved Bilinear CNN Model for Remote Sensing Scene Classification

Multi-view SoftPool Attention Convolutional Networks for 3D Model Classification.

Context-aware Attentional Pooling (CAP) for Fine-grained Visual Classification

The Application of Two-Level Attention Models in Deep Convolutional Neural Network for Fine-Grained Image Classification

Fine-grained image classification method based on hybrid attention module

Dual attention guided multi-scale CNN for fine-grained image classification

Subtler mixed attention network on fine-grained image classification

Learning Attentive Pairwise Interaction for Fine-Grained Classification

GBP: Graph convolutional network embedded in bilinear pooling for fine-grained encoding

Wasserstein Pooling for Image Classification

Generalized regular spatial pooling for image classification

Multi-modal Factorized Bilinear Pooling with Co-attention Learning for Visual Question Answering.

Improved fine-grained image classification in few-shot learning based on channel-spatial attention and grouped bilinear convolution

Enhanced mechanisms of pooling and channel attention for deep learning feature maps

Cross-convolutional-layer Pooling for Generic Visual Recognition.

Learning Relative Features Through Adaptive Pooling for Image Classification

DB-Net: Dual Attention Network with Bilinear Pooling for Fire-Smoke Image Classification