Abstract:Artificial intelligence and neuroscience have a long and intertwined history. Advancements in neuroscience research have significantly influenced the development of artificial intelligence systems that have the potential to retain knowledge akin to humans. Building upon foundational insights from neuroscience and existing research in adversarial and continual learning fields, we introduce a novel framework that comprises two key concepts: feature distillation and re-consolidation. The framework distills continual learning (CL) robust features and rehearses them while learning the next task, aiming to replicate the mammalian brain's process of consolidating memories through rehearsing the distilled version of the waking experiences. Furthermore, the proposed framework emulates the mammalian brain's mechanism of memory re-consolidation, where novel experiences influence the assimilation of previous experiences via feature re-consolidation. This process incorporates the new understanding of the CL model after learning the current task into the CL-robust samples of the previous task(s) to mitigate catastrophic forgetting. The proposed framework, called Robust Rehearsal, circumvents the limitations of existing CL frameworks that rely on the availability of pre-trained Oracle CL models to pre-distill CL-robustified datasets for training subsequent CL models. We conducted extensive experiments on three datasets, CIFAR10, CIFAR100, and real-world helicopter attitude datasets, demonstrating that CL models trained using Robust Rehearsal outperform their counterparts' baseline methods. In addition, we conducted a series of experiments to assess the impact of changing memory sizes and the number of tasks, demonstrating that the baseline methods employing robust rehearsal outperform other methods trained without robust rehearsal. Lastly, to shed light on the existence of diverse features, we explore the effects of various optimization training objectives within the realms of joint, continual, and adversarial learning on feature learning in deep neural networks. Our findings indicate that the optimization objective dictates feature learning, which plays a vital role in model performance. Such observation further emphasizes the importance of rehearsing the CL-robust samples in alleviating catastrophic forgetting. In light of our experiments, closely following neuroscience insights can contribute to developing CL approaches to mitigate the long-standing challenge of catastrophic forgetting.

SYNERgy between SYNaptic consolidation and Experience Replay for general continual learning

Learning Fast, Learning Slow: A General Continual Learning Method based on Complementary Learning System

Overcoming Long-Term Catastrophic Forgetting Through Adversarial Neural Pruning and Synaptic Consolidation

Dual Memory Model for Experience-Once Task-Incremental Lifelong Learning.

Saliency-Guided Hidden Associative Replay for Continual Learning

Learning Bayesian Sparse Networks with Full Experience Replay for Continual Learning

Brain-Inspired Continual Learning: Robust Feature Distillation and Re-Consolidation for Class Incremental Learning

Brain-Inspired Continual Learning-Robust Feature Distillation and Re-Consolidation for Class Incremental Learning

A Study of Biologically Plausible Neural Network: The Role and Interactions of Brain-Inspired Mechanisms in Continual Learning

MGSER-SAM: Memory-Guided Soft Experience Replay with Sharpness-Aware Optimization for Enhanced Continual Learning

Continual Learning with Strong Experience Replay

SynapNet: A Complementary Learning System Inspired Algorithm With Real-Time Application in Multimodal Perception

Memory Enhanced Replay for Continual Learning

Continual Learning: Tackling Catastrophic Forgetting in Deep Neural Networks with Replay Processes

Coordinating Experience Replay: A Harmonious Experience Retention approach for Continual Learning

Sparse Coding in a Dual Memory System for Lifelong Learning

Beyond Unimodal Learning: The Importance of Integrating Multiple Modalities for Lifelong Learning

Continual learning benefits from multiple sleep mechanisms: NREM, REM, and Synaptic Downscaling

Deep Generative Dual Memory Network for Continual Learning

A Unified and General Framework for Continual Learning

Squeezing More Past Knowledge for Online Class-Incremental Continual Learning