Abstract:Webly supervised fine-grained recognition aims to distinguish subordinate categories (e.g., bird species) with freely available web data. It has significant research and application value for alleviating the costly professional manual annotations' dependence in the fine-grained recognition task. Nevertheless, there exists label noise in web data to decrease the model's recognition performance. Most existing methods attempt to select clean data via loss analyses, which favors easy samples to hinder mining subtle differences contained in hard samples. Inspired by the intrinsic trait of consistent semantic predictions among different hierarchies of clean samples in fine-grained recognition, we propose a hierarchical consistency learning (HCL) approach for detecting noisy samples and capturing multi-hierarchy discriminative clues simultaneously. Specifically, our HCL approach works in a coarse-to-fine order, which first explores the semantic consistency between the image level and object level through prediction distribution conformance analyses. The open-set noise (i.e., samples irrelevant to any fine-grained subcategory) is thus detected, and the visual object information is highlighted with image-object contrastive learning. Then, the semantic consistency between object-level and part-level prediction distributions is utilized for detecting closed-set noise (i.e., samples mislabeled as other fine-grained subcategories), and local discriminative information is enhanced with object-part contrastive learning. Extensive experiments and analyses on three widely-used webly supervised fine-grained benchmark datasets demonstrate that the proposed HCL approach can achieve new state-of-the-art. The code is available at https://github.com/PKU-ICST-MIPL/HCL_TMM2023.

Consistency-aware Feature Learning for Hierarchical Fine-grained Visual Classification

FGCM: Noisy Label Learning via Fine-Grained Confidence Modeling

Learning Enhanced Features and Inferring Twice for Fine-Grained Image Classification

HLS-FGVC: Hierarchical Label Semantics Enhanced Fine-Grained Visual Classification.

Hierarchical Fine-Grained Visual Classification Leveraging Consistent Hierarchical Knowledge

Hierarchical Self-Distilled Feature Learning for Fine-Grained Visual Categorization

HCL: Hierarchical Consistency Learning for Webly Supervised Fine-Grained Recognition

Multi-Granularity Feature Distillation Learning Network for Fine-Grained Visual Classification

Fine-grained Category Discovery under Coarse-grained Supervision with Hierarchical Weighted Self-contrastive Learning

Granularity-aware Distillation and Structure Modeling Region Proposal Network for Fine-Grained Image Classification.

Where to Focus: Investigating Hierarchical Attention Relationship for Fine-Grained Visual Classification

Integrating Foreground–background Feature Distillation and Contrastive Feature Learning for Ultra-Fine-grained Visual Classification

Feature Re-Attention and Multi-Layer Feature Fusion for Fine-Grained Visual Classification

Fine-grained Visual Classification with Multi-Scale Features Based on Self-Supervised Attention Filtering Mechanism

Label Relation Graphs Enhanced Hierarchical Residual Network for Hierarchical Multi-Granularity Classification

Learning Hierarchal Channel Attention for Fine-grained Visual Classification.

Exploiting Category Similarity-Based Distributed Labeling for Fine-Grained Visual Classification

Consistency-Aware Customized Learning for Cross-Scene Hyperspectral Image Classification

Hierarchical Part Matching for Fine-Grained Visual Categorization

Leveraging Fine-Grained Labels to Regularize Fine-Grained Visual Classification.

Bridge the gap between supervised and unsupervised learning for fine-grained classification