Abstract:Continual learning (CL) aims to learn new tasks without forgetting previous tasks. However, existing CL methods require a large amount of raw data, which is often unavailable due to copyright considerations and privacy risks. Instead, stakeholders usually release pre-trained machine learning models as a service (MLaaS), which users can access via APIs. This paper considers two practical-yet-novel CL settings: data-efficient CL (DECL-APIs) and data-free CL (DFCL-APIs), which achieve CL from a stream of APIs with partial or no raw data. Performing CL under these two new settings faces several challenges: unavailable full raw data, unknown model parameters, heterogeneous models of arbitrary architecture and scale, and catastrophic forgetting of previous APIs. To overcome these issues, we propose a novel data-free cooperative continual distillation learning framework that distills knowledge from a stream of APIs into a CL model by generating pseudo data, just by querying APIs. Specifically, our framework includes two cooperative generators and one CL model, forming their training as an adversarial game. We first use the CL model and the current API as fixed discriminators to train generators via a derivative-free method. Generators adversarially generate hard and diverse synthetic data to maximize the response gap between the CL model and the API. Next, we train the CL model by minimizing the gap between the responses of the CL model and the black-box API on synthetic data, to transfer the API's knowledge to the CL model. Furthermore, we propose a new regularization term based on network similarity to prevent catastrophic forgetting of previous APIs.Our method performs comparably to classic CL with full raw data on the MNIST and SVHN in the DFCL-APIs setting. In the DECL-APIs setting, our method achieves 0.97x, 0.75x and 0.69x performance of classic CL on CIFAR10, CIFAR100, and MiniImageNet.

Just Say the Name: Online Continual Learning with Category Names Only via Data Generation

From Categories to Classifiers: Name-Only Continual Learning by Exploring the Web

Online Continuous Generalized Category Discovery

CLoG: Benchmarking Continual Learning of Image Generation Models

Exploring Continual Learning for Code Generation Models

Non-Exemplar Online Class-incremental Continual Learning via Dual-prototype Self-augment and Refinement

Regularized Training with Generated Datasets for Name-Only Transfer of Vision-Language Models

Continual Learning for Autonomous Robots: A Prototype-based Approach

Online Continual Learning For Interactive Instruction Following Agents

A Neural Span-Based Continual Named Entity Recognition Model

Premonition: Using Generative Models to Preempt Future Data Changes in Continual Learning

Continual Learning for Natural Language Generation in Task-oriented Dialog Systems

Online Prototype Learning for Online Continual Learning

Rethinking the Effect of Uninformative Class Name in Prompt Learning

Continual Learning From a Stream of APIs

Towards Generative Class Prompt Learning for Few-shot Visual Recognition

Online Active Continual Learning for Robotic Lifelong Object Recognition

HCL: Hierarchical Consistency Learning for Webly Supervised Fine-Grained Recognition

Dealing with Synthetic Data Contamination in Online Continual Learning

Regeneration Learning: A Learning Paradigm for Data Generation

AdaptCL: Adaptive Continual Learning for Tackling Heterogeneity in Sequential Datasets