Abstract:Catastrophic forgetting has become an intractable problem in the continual learning setting because previous data is not accessible when training. To mitigate this problem, memory-based continual learning methods replay previous data from a fixed-size memory buffer. Reservoir sampling, which can sample uniformly from streaming data in a single pass and randomly delete a few buffered samples to keep the memory capacity, is widely used in the memory update process. Nevertheless, the random deletion will cause the agent to miss some high-quality samples, which are more effective in overcoming forgetting. In this paper, we propose a novel memory update method, Class-level Minimally Interfered Update (CMIU), which can maintain the sampling randomness and remove the worthless samples from the same classes as the randomly deleting samples. Concretely, CMIU deletes the samples that are minimally interfered with the agent update. The experiments show that CMIU presents improved performance compared to the baselines on both balanced and imbalanced data streams in the online continual learning setting.

Continual Learning with Class-Level Minimally Interfered Update