Abstract:Constantly discovering novel concepts is crucial in evolving environments. This paper explores the underexplored task of Continual Generalized Category Discovery (C-GCD), which aims to incrementally discover new classes from unlabeled data while maintaining the ability to recognize previously learned classes. Although several settings are proposed to study the C-GCD task, they have limitations that do not reflect real-world scenarios. We thus study a more practical C-GCD setting, which includes more new classes to be discovered over a longer period, without storing samples of past classes. In C-GCD, the model is initially trained on labeled data of known classes, followed by multiple incremental stages where the model is fed with unlabeled data containing both old and new classes. The core challenge involves two conflicting objectives: discover new classes and prevent forgetting old ones. We delve into the conflicts and identify that models are susceptible to prediction bias and hardness bias. To address these issues, we introduce a debiased learning framework, namely Happy, characterized by Hardness-aware prototype sampling and soft entropy regularization. For the prediction bias, we first introduce clustering-guided initialization to provide robust features. In addition, we propose soft entropy regularization to assign appropriate probabilities to new classes, which can significantly enhance the clustering performance of new classes. For the harness bias, we present the hardness-aware prototype sampling, which can effectively reduce the forgetting issue for previously seen classes, especially for difficult classes. Experimental results demonstrate our method proficiently manages the conflicts of C-GCD and achieves remarkable performance across various datasets, e.g., 7.5% overall gains on ImageNet-100. Our code is publicly available at <a class="link-external link-https" href="https://github.com/mashijie1028/Happy-CGCD" rel="external noopener nofollow">this https URL</a>.

Prediction Consistency Regularization for Generalized Category Discovery

Prototypical Classifier with Distribution Consistency Regularization for Generalized Category Discovery: A Strong Baseline

Generalized Category Discovery with Clustering Assignment Consistency

Memory Consistency Guided Divide-and-Conquer Learning for Generalized Category Discovery

Efficient Representation Learning for Generalized Category Discovery

Learning to Distinguish Samples for Generalized Category Discovery

Parametric Classification for Generalized Category Discovery: A Baseline Study

Let’s Start Over: Retraining with Selective Samples for Generalized Category Discovery

Contextuality Helps Representation Learning for Generalized Category Discovery

Learning Semi-supervised Gaussian Mixture Models for Generalized Category Discovery

Active Generalized Category Discovery

Solving the Catastrophic Forgetting Problem in Generalized Category Discovery

Generalized Categories Discovery for Long-tailed Recognition

A Fresh Look at Generalized Category Discovery through Non-negative Matrix Factorization

Contrastive Mean-Shift Learning for Generalized Category Discovery

Feature Extractor Optimization for Discriminative Representations in Generalized Category Discovery

Happy: A Debiased Learning Framework for Continual Generalized Category Discovery

No Representation Rules Them All in Category Discovery

Multimodal Generalized Category Discovery

CLIP-GCD: Simple Language Guided Generalized Category Discovery

AdaptGCD: Multi-Expert Adapter Tuning for Generalized Category Discovery