Abstract:In this paper, we introduce our approach to the 5th CLVision Challenge, which presents distinctive challenges beyond traditional class incremental learning. Unlike standard settings, this competition features the recurrence of previously encountered classes and includes unlabeled data that may contain Out-of-Distribution (OOD) categories. Our approach is based on Winning Subnetworks to allocate independent parameter spaces for each task addressing the catastrophic forgetting problem in class incremental learning and employ three training strategies: supervised classification learning, unsupervised contrastive learning, and pseudo-label classification learning to fully utilize the information in both labeled and unlabeled data, enhancing the classification performance of each subnetwork. Furthermore, during the inference stage, we have devised an interaction strategy between subnetworks, where the prediction for a specific class of a particular sample is the average logits across different subnetworks corresponding to that class, leveraging the knowledge learned from different subnetworks on recurring classes to improve classification accuracy. These strategies can be simultaneously applied to the three scenarios of the competition, effectively solving the difficulties in the competition scenarios. Experimentally, our method ranks first in both the pre-selection and final evaluation stages, with an average accuracy of 0.4535 during the preselection stage and an average accuracy of 0.4805 during the final evaluation stage.

What problem does this paper attempt to address?

The paper primarily addresses the issues presented in the 5th CLVISION Challenge. The problem setting of the challenge goes beyond the traditional scope of class-incremental learning and has the following characteristics: 1. **Reoccurring Classes**: Unlike the standard setting, in this competition, previously encountered classes reappear in subsequent tasks. 2. **Inclusion of Unlabeled Data**: The training data includes not only labeled data but also unlabeled data that may contain out-of-distribution (OOD) classes. To tackle these challenges, the authors propose a method based on "Winning Subnetworks" to allocate independent parameter spaces to each task, thereby alleviating the catastrophic forgetting problem in class-incremental learning. Additionally, they employ three training strategies: 1. **Supervised Classification Learning**: Training with labeled data using cross-entropy loss. 2. **Unsupervised Contrastive Learning**: Extracting discriminative and robust features from unlabeled data. 3. **Pseudo-Label Classification Learning**: Identifying confident unlabeled data through high-confidence constraints and using their pseudo-labels to enhance classification performance. During the inference phase, the authors designed an interaction strategy between subnetworks, where the prediction for a specific class of a specific sample is derived from the average logits values of the corresponding class from different subnetworks. This method effectively utilizes the knowledge learned by different subnetworks on reoccurring classes, thereby improving classification accuracy. Ultimately, their method ranked first in both the preliminary and final stages, achieving an average accuracy of 0.4535 and 0.4805, respectively. In summary, this paper aims to address the issue of reoccurring classes in open-set semi-supervised class-incremental learning and proposes an effective solution.

The Championship-Winning Solution for the 5th CLVISION Challenge 2024

The Solution for the sequential task continual learning track of the 2nd Greater Bay Area International Algorithm Competition

2nd Place Solution for ICCV 2021 VIPriors Image Classification Challenge: An Attract-and-Repulse Learning Approach

Mejigclu: more effective jigsaw clustering for unsupervised visual representation learning

1st Place Solution for ECCV 2022 OOD-CV Challenge Image Classification Track

Mitigating Catastrophic Forgetting in Task-Incremental Continual Learning with Adaptive Classification Criterion

Incremental Scene Classification Using Dual Knowledge Distillation and Classifier Discrepancy on Natural and Remote Sensing Images

PNSP: Overcoming Catastrophic Forgetting Using Primary Null Space Projection in Continual Learning

Self-Training and Curriculum Learning Guided Dynamic Refined Network for Remote Sensing Class-Incremental Semantic Segmentation

ICL-TSVD: Bridging Theory and Practice in Continual Learning with Pre-trained Models

Complementary Learning Subnetworks for Parameter-Efficient Class-Incremental Learning

TCP: Triplet Contrastive-relationship Preserving for Class-Incremental Learning

Enhancing Class-Incremental Learning for Image Classification Via Bidirectional Transport and Selective Momentum

Progressive Training Technique with Weak-Label Boosting for Fine-Grained Classification on Unbalanced Training Data

Overcoming Catastrophic Forgetting with Unlabeled Data in the Wild

Adaptive online continual multi-view learning

Class-Incremental Learning: A Survey

Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learning

The Solution for the CVPR2023 NICE Image Captioning Challenge

Learning a Unified Classifier Incrementally via Rebalancing

Combining Past, Present and Future: A Self-Supervised Approach for Class Incremental Learning.