Fine-Grained Visual Classification Based on Image Foreground and Sub-category Similarity

Xianjin Jiang,Xin Lin,Yi Ji,Jianyu Yang,Chunping Liu
DOI: https://doi.org/10.1007/978-981-10-7305-2_13
2017-01-01
Abstract:We propose a fine-grained visual classification algorithm based on image foreground and sub-category similarity. In the processing of feature extracting, our model calculates the gradient of image pixels in a classification network to obtain the foreground of the image. Then input the foreground image and the original image into the bilinear convolution network to obtain the feature of the image. At the classification stage, we propose an improved SD-SVM algorithm, which takes the advantages of the similarities among sub-categories and the differences among the similarities of sub-category. Experimental results manifest that our algorithm can achieve 85.12% accuracy on the CUB-2011 dataset and 85.21% accuracy on the FGVC-aircrafts dataset even with only the category labels, which outperforms state-of-the-art fine-grained categorization methods.
What problem does this paper attempt to address?