Abstract:Modern deep learning methods have achieved great success in machine learning and computer vision fields by learning a set of pre-defined datasets. Howerver, these methods perform unsatisfactorily when applied into real-world situations. The reason of this phenomenon is that learning new tasks leads the trained model quickly forget the knowledge of old tasks, which is referred to as catastrophic forgetting. Current state-of-the-art incremental learning methods tackle catastrophic forgetting problem in traditional classification networks and ignore the problem existing in embedding networks, which are the basic networks for image retrieval, face recognition, zero-shot learning, etc. Different from traditional incremental classification networks, the semantic gap between the embedding spaces of two adjacent tasks is the main challenge for embedding networks under incremental learning setting. Thus, we propose a novel class-incremental method for embedding network, named as zero-shot translation class-incremental method (ZSTCI), which leverages zero-shot translation to estimate and compensate the semantic gap without any exemplars. Then, we try to learn a unified representation for two adjacent tasks in sequential learning process, which captures the relationships of previous classes and current classes precisely. In addition, ZSTCI can easily be combined with existing regularization-based incremental learning methods to further improve performance of embedding networks. We conduct extensive experiments on CUB-200-2011 and CIFAR100, and the experiment results prove the effectiveness of our method. The code of our method has been released in https://github.com/Drkun/ZSTCI.

Semantic Drift Compensation for Class-Incremental Learning

Class-Incremental Learning for Semantic Segmentation in Aerial Imagery Via Distillation in All Aspects

Class-Incremental Semantic Segmentation of Aerial Images Via Pixel-Level Feature Generation and Task-Wise Distillation

Inherit With Distillation and Evolve With Contrast: Exploring Class Incremental Semantic Segmentation Without Exemplar Memory

Resurrecting Old Classes with New Data for Exemplar-Free Continual Learning

Large Scale Incremental Learning

Exemplar-Supported Representation for Effective Class-Incremental Learning

A class-incremental learning approach for learning feature-compatible embeddings

Incremental Embedding Learning Via Zero-Shot Translation

Semantic Alignment with Self-Supervision for Class Incremental Learning

Incremental Learning In Online Scenario

Exemplar-free Continual Representation Learning via Learnable Drift Compensation

Self-Training for Class-Incremental Semantic Segmentation

Learning to Imagine: Diversify Memory for Incremental Learning using Unlabeled Data

Gradient-Semantic Compensation for Incremental Semantic Segmentation

Class Incremental Learning with Self-Supervised Pre-Training and Prototype Learning

Incremental Embedding Learning with Disentangled Representation Translation.

Class-Incremental Learning Based on Big Dataset Pre-Trained Models

Efficient Non-Exemplar Class-Incremental Learning with Retrospective Feature Synthesis

Continual Attentive Fusion for Incremental Learning in Semantic Segmentation