Abstract:Webly supervised fine-grained recognition aims to distinguish subordinate categories (e.g., bird species) with freely available web data. It has significant research and application value for alleviating the costly professional manual annotations' dependence in the fine-grained recognition task. Nevertheless, there exists label noise in web data to decrease the model's recognition performance. Most existing methods attempt to select clean data via loss analyses, which favors easy samples to hinder mining subtle differences contained in hard samples. Inspired by the intrinsic trait of consistent semantic predictions among different hierarchies of clean samples in fine-grained recognition, we propose a hierarchical consistency learning (HCL) approach for detecting noisy samples and capturing multi-hierarchy discriminative clues simultaneously. Specifically, our HCL approach works in a coarse-to-fine order, which first explores the semantic consistency between the image level and object level through prediction distribution conformance analyses. The open-set noise (i.e., samples irrelevant to any fine-grained subcategory) is thus detected, and the visual object information is highlighted with image-object contrastive learning. Then, the semantic consistency between object-level and part-level prediction distributions is utilized for detecting closed-set noise (i.e., samples mislabeled as other fine-grained subcategories), and local discriminative information is enhanced with object-part contrastive learning. Extensive experiments and analyses on three widely-used webly supervised fine-grained benchmark datasets demonstrate that the proposed HCL approach can achieve new state-of-the-art. The code is available at https://github.com/PKU-ICST-MIPL/HCL_TMM2023.

A Three-Stage Curriculum Learning Framework with Hierarchical Label Smoothing for Fine-Grained Entity Typing.

FGCM: Noisy Label Learning via Fine-Grained Confidence Modeling

Alleviate Dataset Shift Problem in Fine-Grained Entity Typing with Virtual Adversarial Training

Label Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embedding

Few-Shot Fine-Grained Entity Typing with Automatic Label Interpretation and Instance Generation

From Ultra-Fine to Fine: Fine-tuning Ultra-Fine Entity Typing Models to Fine-grained

Type-enriched Hierarchical Contrastive Strategy for Fine-Grained Entity Typing

Ultra-Fine Entity Typing with Prior Knowledge about Labels: A Simple Clustering Based Strategy

Improving Distantly-supervised Entity Typing with Compact Latent Space Clustering

Generative Entity Typing with Curriculum Learning

Calibrated Seq2seq Models for Efficient and Generalizable Ultra-fine Entity Typing

Learning Entity Type Structured Embeddings with Trustworthiness on Noisy Knowledge Graphs

Cross-Lingual Contrastive Learning for Fine-Grained Entity Typing for Low-Resource Languages

EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on Coreference Chains

OntoType: Ontology-Guided and Pre-Trained Language Model Assisted Fine-Grained Entity Typing

Fine-Grained Classification with Noisy Labels

Enhancing Low-resource Fine-grained Named Entity Recognition by Leveraging Coarse-grained Datasets

ACE: A Coarse-to-Fine Learning Framework for Reliable Representation Learning Against Label Noise

HCL: Hierarchical Consistency Learning for Webly Supervised Fine-Grained Recognition

Coarse-to-fine Few-shot Learning for Named Entity Recognition

Embedding Label Structures for Fine-Grained Feature Representation