Abstract:The main purpose of Continual Learning is to prevent the catastrophic forgetting. A number of the recent methods utilize a replay buffer to keep the knowledge of previous tasks. However, the data from previous tasks may be limited. In this setting, the model face a challenge to strike a balance between plasticity and stability. If the model becomes overfit to the current task data, its performance will suffer when faced with new tasks. Conversely, if the model fails to retain the knowledge it has already learned, the new features will cover the old feature, resulting in catastrophic forgetting. To address this issue, we propose a novel method for continual learning, called RSM, which aims to maintain the features of old tasks and allocate new features while learning new tasks. RSM utilizes a CVAE to mimic the previous representation space. To maintain previous features while learning new tasks, we incorporate both real data and pseudo-features generated by CVAE in the representation learning and distillation process. Experiments conducted on benchmark datasets show that our method has demonstrated superior performance compared to replay-free and replay-based methods.

Representation Space Maintenance: Against Forgetting in Continual Learning