Abstract:Fine-grained image recognition is a longstanding computer vision challenge that focuses on differentiating objects belonging to multiple subordinate categories within the same meta-category. Since images belonging to the same meta-category usually share similar visual appearances, mining discriminative visual cues is the key to distinguishing fine-grained categories. Although commonly used image-level data augmentation techniques have achieved great success in generic image classification problems, they are rarely applied in fine-grained scenarios, because their random editing-region behavior is prone to destroy the discriminative visual cues residing in the subtle regions. In this paper, we propose diversifying the training data at the feature-level to alleviate the discriminative region loss problem. Specifically, we produce diversified augmented samples by translating image features along semantically meaningful directions. The semantic directions are estimated with a covariance prediction network, which predicts a sample-wise covariance matrix to adapt to the large intra-class variation inherent in fine-grained images. Furthermore, the covariance prediction network is jointly optimized with the classification network in a meta-learning manner to alleviate the degenerate solution problem. Experiments on four competitive fine-grained recognition benchmarks (CUB-200-2011, Stanford Cars, FGVC Aircrafts, NABirds) demonstrate that our method significantly improves the generalization performance on several popular classification networks (e.g., ResNets, DenseNets, EfficientNets, RegNets and ViT). Combined with a recently proposed method, our semantic data augmentation approach achieves state-of-the-art performance on the CUB-200-2011 dataset. Source code is available at https://github.com/LeapLabTHU/LearnableISDA.

Robust Attribute-Based Visual Recognition Using Discriminative Latent Representation.

Learning Predictable And Discriminative Attributes For Visual Recognition

Beyond Semantic Attributes: Discrete Latent Attributes Learning for Zero-Shot Recognition

Zero-shot Recognition with Latent Visual Attributes Learning.

Learning Concise and Descriptive Attributes for Visual Recognition

Discriminative Block-Diagonal Representation Learning for Image Recognition

Shaping Visual Representations with Attributes for Few-Shot Recognition

Learning Latent Semantic Attributes for Zero-Shot Object Detection.

Robust Face Recognition Via Discriminative and Common Hybrid Dictionary Learning.

Robust RGB-D Face Recognition Using Attribute-Aware Loss

Learning Discriminative Latent Attributes for Zero-Shot Classification.

Learning attribute-aware dictionary for image classification and search

Appearance-based Complex-Attributes Learning for Fine-Grained Recognition

Intra- and Inter-Class Induced Discriminative Deep Dictionary Learning for Visual Recognition

Learning complementary semantic information for zero-shot recognition

An Innovative Weighted 2DLDA Approach for Face Recognition

Pose-Based Discriminative-Attributes Learning for Fine-Grained Recognition

High-Discriminative Attribute Feature Learning for Generalized Zero-Shot Learning

Fine-Grained Recognition With Learnable Semantic Data Augmentation

Robust and Discriminative Dictionary Learning for Face Recognition.

Discriminative Locality-Constrained Sparse Representation for Robust Face Recognition