Abstract:Fine-grained image recognition is a longstanding computer vision challenge that focuses on differentiating objects belonging to multiple subordinate categories within the same meta-category. Since images belonging to the same meta-category usually share similar visual appearances, mining discriminative visual cues is the key to distinguishing fine-grained categories. Although commonly used image-level data augmentation techniques have achieved great success in generic image classification problems, they are rarely applied in fine-grained scenarios, because their random editing-region behavior is prone to destroy the discriminative visual cues residing in the subtle regions. In this paper, we propose diversifying the training data at the feature-level to alleviate the discriminative region loss problem. Specifically, we produce diversified augmented samples by translating image features along semantically meaningful directions. The semantic directions are estimated with a covariance prediction network, which predicts a sample-wise covariance matrix to adapt to the large intra-class variation inherent in fine-grained images. Furthermore, the covariance prediction network is jointly optimized with the classification network in a meta-learning manner to alleviate the degenerate solution problem. Experiments on four competitive fine-grained recognition benchmarks (CUB-200-2011, Stanford Cars, FGVC Aircrafts, NABirds) demonstrate that our method significantly improves the generalization performance on several popular classification networks (e.g., ResNets, DenseNets, EfficientNets, RegNets and ViT). Combined with a recently proposed method, our semantic data augmentation approach achieves state-of-the-art performance on the CUB-200-2011 dataset. Source code is available at https://github.com/LeapLabTHU/LearnableISDA.

A multi-task learning model with adversarial data augmentation for classification of fine-grained images

Improving Fine-Grained Object Classification Using Adversarial Generated Unlabelled Samples.

CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training

Selective Synthetic Augmentation with Quality Assurance

Emotion Classification with Data Augmentation Using Generative Adversarial Networks

Fine-Grained Recognition With Learnable Semantic Data Augmentation

Effective Data Augmentation with Multi-Domain Learning GANs

Semi-Supervised Fine-Grained Image Categorization Using Transfer Learning with Hierarchical Multi-Scale Adversarial Networks

Multi-class imbalanced image classification using conditioned GANs

Fine-Grained Multi-Attribute Adversarial Learning for Face Generation of Age, Gender and Ethnicity

Data Augmentation in Emotion Classification Using Generative Adversarial Networks

Collaborative Discrimination-Enabled Generative Adversarial Network (CoD-GAN) for the Data Augmentation in Imbalanced Classification

Attention-Guided CutMix Data Augmentation Network for Fine-Grained Bird Recognition.

AdvMask: A Sparse Adversarial Attack Based Data Augmentation Method for Image Classification

Domain Adaptive Transfer Learning on Visual Attention Aware Data Augmentation for Fine-grained Visual Categorization

ECGAN: An Improved Conditional Generative Adversarial Network With Edge Detection to Augment Limited Training Data for the Classification of Remote Sensing Images With High Spatial Resolution

Data Augmentation Based on Generative Adversarial Network with Mixed Attention Mechanism

Adversarial Feature Hallucination Networks for Few-Shot Learning

DADA: Deep Adversarial Data Augmentation for Extremely Low Data Regime Classification

Adversarial Feature Augmentation and Normalization for Visual Recognition

Multi-class GAN for generating multi-class images in object recognition