Abstract:As the data scale grows, deep recognition models often suffer from long-tailed data distributions due to the heavy imbalanced sample number across categories. Indeed, real-world data usually exhibit some similarity relation among different categories (e.g., pigeons and sparrows), called category similarity in this work. It is doubly difficult when the imbalance occurs between such categories with similar appearances. However, existing solutions mainly focus on the sample number to re-balance data distribution. In this work, we systematically investigate the essence of the long-tailed problem from a unified perspective. Specifically, we demonstrate that long-tailed recognition suffers from both sample number and category similarity. Intuitively, using a toy example, we first show that sample number is not the unique influence factor for performance dropping of long-tailed recognition. Theoretically, we demonstrate that (1) category similarity, as an inevitable factor, would also influence the model learning under long-tailed distribution via similar samples, (2) using more discriminative representation methods (e.g., self-supervised learning) for similarity reduction, the classifier bias can be further alleviated with greatly improved performance. Extensive experiments on several long-tailed datasets verify the rationality of our theoretical analysis, and show that based on existing state-of-the-arts (SOTAs), the performance could be further improved by similarity reduction. Our investigations highlight the essence behind the long-tailed problem, and claim several feasible directions for future work.

Detecting Basic Level Categories by Term Weighting and Feature Entropy

Rare Category Detection Algorithm Based on Weighted Boundary Degree

A Knowledge-Based Semisupervised Hierarchical Online Topic Detection Framework.

Rare Category Exploration Via Wavelet Analysis: Theory and Applications

Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding

Text Categorization Based on Domain Ontology

A Semantic Term Weighting Scheme for Text Categorization.

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

Exploiting Level-Wise Category Links for Semantic Relatedness Computing

Dimensionality Reduction With Category Information Fusion And Non-Negative Matrix Factorization For Text Categorization

Exploiting Category Information and Document Information to Improve Term Weighting for Text Categorization

A Text Clustering Algorithm to Detect Basic Level Categories in Texts

A Generic Method for Fine-grained Category Discovery in Natural Language Texts

An Inference Approach to Basic Level of Categorization.

A Novel Term Weighting Scheme for Automated Text Categorization

A Comparative Study on Feature Weight in Text Categorization

Scalable Term Selection for Text Categorization.

Investigate the Essence of Long-Tailed Recognition from a Unified Perspective

Unsupervised Template Mining for Semantic Category Understanding.

Hierarchy-Regularized Latent Semantic Indexing

Measuring Similarity Of Chinese Web Databases Based On Category Hierarchy