Abstract:Constantly discovering novel concepts is crucial in evolving environments. This paper explores the underexplored task of Continual Generalized Category Discovery (C-GCD), which aims to incrementally discover new classes from unlabeled data while maintaining the ability to recognize previously learned classes. Although several settings are proposed to study the C-GCD task, they have limitations that do not reflect real-world scenarios. We thus study a more practical C-GCD setting, which includes more new classes to be discovered over a longer period, without storing samples of past classes. In C-GCD, the model is initially trained on labeled data of known classes, followed by multiple incremental stages where the model is fed with unlabeled data containing both old and new classes. The core challenge involves two conflicting objectives: discover new classes and prevent forgetting old ones. We delve into the conflicts and identify that models are susceptible to prediction bias and hardness bias. To address these issues, we introduce a debiased learning framework, namely Happy, characterized by Hardness-aware prototype sampling and soft entropy regularization. For the prediction bias, we first introduce clustering-guided initialization to provide robust features. In addition, we propose soft entropy regularization to assign appropriate probabilities to new classes, which can significantly enhance the clustering performance of new classes. For the harness bias, we present the hardness-aware prototype sampling, which can effectively reduce the forgetting issue for previously seen classes, especially for difficult classes. Experimental results demonstrate our method proficiently manages the conflicts of C-GCD and achieves remarkable performance across various datasets, e.g., 7.5% overall gains on ImageNet-100. Our code is publicly available at <a class="link-external link-https" href="https://github.com/mashijie1028/Happy-CGCD" rel="external noopener nofollow">this https URL</a>.

Generalized Categories Discovery for Long-tailed Recognition

ImbaGCD: Imbalanced Generalized Category Discovery

Solving the Catastrophic Forgetting Problem in Generalized Category Discovery

Active Generalized Category Discovery

Efficient Representation Learning for Generalized Category Discovery

Let’s Start Over: Retraining with Selective Samples for Generalized Category Discovery

Learning to Distinguish Samples for Generalized Category Discovery

Generalized Category Discovery in Aerial Image Classification via Slot Attention

Generalized Category Discovery with Clustering Assignment Consistency

Memory Consistency Guided Divide-and-Conquer Learning for Generalized Category Discovery

A Fresh Look at Generalized Category Discovery through Non-negative Matrix Factorization

MetaGCD: Learning to Continually Learn in Generalized Category Discovery

Contextuality Helps Representation Learning for Generalized Category Discovery

Happy: A Debiased Learning Framework for Continual Generalized Category Discovery

Feature Extractor Optimization for Discriminative Representations in Generalized Category Discovery

Learning Semi-supervised Gaussian Mixture Models for Generalized Category Discovery

Multimodal Generalized Category Discovery

Prototypical Classifier with Distribution Consistency Regularization for Generalized Category Discovery: A Strong Baseline

Generalized Category Discovery in Semantic Segmentation

HiLo: A Learning Framework for Generalized Category Discovery Robust to Domain Shifts

CLIP-GCD: Simple Language Guided Generalized Category Discovery