Abstract:The goal of Continual Learning (CL) is to continuously learn from new data streams and accomplish the corresponding tasks. Previously studied CL assumes that data are given in sequence nose-to-tail for different tasks, thus indeed belonging to Serial Continual Learning (SCL). This paper studies the novel paradigm of Parallel Continual Learning (PCL) in dynamic multi-task scenarios, where a diverse set of tasks is encountered at different time points. PCL presents challenges due to the training of an unspecified number of tasks with varying learning progress, leading to the difficulty of guaranteeing effective model updates for all encountered tasks. In our previous conference work, we focused on measuring and reducing the discrepancy among gradients in a multi-objective optimization problem, which, however, may still contain negative transfers in every model update. To address this issue, in the dynamic multi-objective optimization problem, we introduce task-specific elastic factors to adjust the descent direction towards the Pareto front. The proposed method, called Elastic Multi-Gradient Descent (EMGD), ensures that each update follows an appropriate Pareto descent direction, minimizing any negative impact on previously learned tasks. To balance the training between old and new tasks, we also propose a memory editing mechanism guided by the gradient computed using EMGD. This editing process updates the stored data points, reducing interference in the Pareto descent direction from previous tasks. Experiments on public datasets validate the effectiveness of our EMGD in the PCL setting.

Adaptive Variational Continual Learning via Task-Heuristic Modelling

EVCL: Elastic Variational Continual Learning with Weight Consolidation

Temporal-Difference Variational Continual Learning

Meta Continual Learning Revisited: Implicitly Enhancing Online Hessian Approximation Via Variance Reduction.

Variational Adaptive-Newton Method for Explorative Learning

Adaptive Hyperparameter Optimization for Continual Learning Scenarios

An Effective Dynamic Gradient Calibration Method for Continual Learning

Mixture-of-Variational-Experts for Continual Learning

Variational Adversarial Kernel Learned Imitation Learning.

Elastic Multi-Gradient Descent for Parallel Continual Learning

Variational Automatic Curriculum Learning for Sparse-Reward Cooperative Multi-Agent Problems

Task-Aware Variational Adversarial Active Learning

A Variance Minimization Approach to Temporal-Difference Learning

Similarity-Based Adaptation for Task-Aware and Task-Free Continual Learning

Hidden Talents of the Variational Autoencoder

Variational Continual Test-Time Adaptation

Variational Continual Bayesian Meta-Learning

VAE-Var: Variational-Autoencoder-Enhanced Variational Assimilation

Variational Stochastic Gradient Descent for Deep Neural Networks

An Energy-Based Self-Adaptive Learning Rate for Stochastic Gradient Descent: Enhancing Unconstrained Optimization with VAV method

Learning Manifold Dimensions with Conditional Variational Autoencoders