Abstract:Fine-grained image recognition is a longstanding computer vision challenge that focuses on differentiating objects belonging to multiple subordinate categories within the same meta-category. Since images belonging to the same meta-category usually share similar visual appearances, mining discriminative visual cues is the key to distinguishing fine-grained categories. Although commonly used image-level data augmentation techniques have achieved great success in generic image classification problems, they are rarely applied in fine-grained scenarios, because their random editing-region behavior is prone to destroy the discriminative visual cues residing in the subtle regions. In this paper, we propose diversifying the training data at the feature-level to alleviate the discriminative region loss problem. Specifically, we produce diversified augmented samples by translating image features along semantically meaningful directions. The semantic directions are estimated with a covariance prediction network, which predicts a sample-wise covariance matrix to adapt to the large intra-class variation inherent in fine-grained images. Furthermore, the covariance prediction network is jointly optimized with the classification network in a meta-learning manner to alleviate the degenerate solution problem. Experiments on four competitive fine-grained recognition benchmarks (CUB-200-2011, Stanford Cars, FGVC Aircrafts, NABirds) demonstrate that our method significantly improves the generalization performance on several popular classification networks (e.g., ResNets, DenseNets, EfficientNets, RegNets and ViT). Combined with a recently proposed method, our semantic data augmentation approach achieves state-of-the-art performance on the CUB-200-2011 dataset. Source code is available at https://github.com/LeapLabTHU/LearnableISDA.

Semantic Enhanced Deep Learning for Image Classification.

Image Semantic Segmentation Based on Region and Deep Residual Network

Representation Learning Via a Semi-Supervised Stacked Distance Autoencoder for Image Classification

Deep Learning-Based Image Semantic Communication System

The image annotation algorithm using convolutional features from intermediate layer of deep learning

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Deep Learning Models for Image Classification: Comparison and Applications

Semantic Embedded Deep Neural Network: A Generic Approach to Boost Multi-Label Image Classification Performance

Deep Learning Model of Image Classification Using Machine Learning

Fine-Grained Recognition With Learnable Semantic Data Augmentation

A Survey on Deep Learning-based Architectures for Semantic Segmentation on 2D images

Towards Semantic Communications: Deep Learning-Based Image Semantic Coding

Semantic-Aware Triplet Loss for Image Classification.

Denoising Auto-Encoders Toward Robust Unsupervised Feature Representation.

Hyperspectral Image Classification With Deep Learning Models

Toward Semantic Communications: Deep Learning-Based Image Semantic Coding

Research on semantic segmentation algorithm of multispectral remote sensing image based on deep learning

Deep Learning for Automatic IC Image Analysis.

Deep Learning for Video Classification and Captioning

DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs

DeepSentiBank: Visual Sentiment Concept Classification with Deep Convolutional Neural Networks