Abstract:Learning from demonstration (LfD) provides an efficient way to train robots. The learned motions should be convergent and stable, but to be truly effective in the real world, LfD-capable robots should also be able to remember multiple motion skills. Existing stable-LfD approaches lack the capability of multi-skill retention. Although recent work on continual-LfD has shown that hypernetwork-generated neural ordinary differential equation solvers (NODE) can learn multiple LfD tasks sequentially, this approach lacks stability guarantees. We propose an approach for stable continual-LfD in which a hypernetwork generates two networks: a trajectory learning dynamics model, and a trajectory stabilizing Lyapunov function. The introduction of stability generates convergent trajectories, but more importantly it also greatly improves continual learning performance, especially in the size-efficient chunked hypernetworks. With our approach, a single hypernetwork learns stable trajectories of the robot's end-effector position and orientation simultaneously, and does so continually for a sequence of real-world LfD tasks without retraining on past demonstrations. We also propose stochastic hypernetwork regularization with a single randomly sampled regularization term, which reduces the cumulative training time cost for N tasks from O$(N^2)$ to O$(N)$ without any loss in performance on real-world tasks. We empirically evaluate our approach on the popular LASA dataset, on high-dimensional extensions of LASA (including up to 32 dimensions) to assess scalability, and on a novel extended robotic task dataset (RoboTasks9) to assess real-world performance. In trajectory error metrics, stability metrics and continual learning metrics our approach performs favorably, compared to other baselines. Our open-source code and datasets are available at <a class="link-external link-https" href="https://github.com/sayantanauddy/clfd-snode" rel="external noopener nofollow">this https URL</a>.

Towards stable training of parallel continual learning

Progressive Learning without Forgetting

UniGrad-FS: Unified Gradient Projection with Flatter Sharpness for Continual Learning

Elastic Multi-Gradient Descent for Parallel Continual Learning

ICL-TSVD: Bridging Theory and Practice in Continual Learning with Pre-trained Models

CoSCL: Cooperation of Small Continual Learners is Stronger than a Big One

Continual Learning by Using Information of Each Class Holistically.

Measuring Asymmetric Gradient Discrepancy in Parallel Continual Learning

Achieving a Better Stability-Plasticity Trade-off via Auxiliary Networks in Continual Learning

Overcoming the Stability Gap in Continual Learning

PNSP: Overcoming Catastrophic Forgetting Using Primary Null Space Projection in Continual Learning

Optimizing Spca-based Continual Learning: A Theoretical Approach.

Exploring the Stability Gap in Continual Learning: The Role of the Classification Head

Adaptive Progressive Continual Learning.

Improving Data-aware and Parameter-aware Robustness for Continual Learning

On the Convergence of Continual Learning with Adaptive Methods

PRETRAINED LANGUAGE MODEL IN CONTINUAL LEARNING: A COMPARATIVE STUDY

Bio-inspired, task-free continual learning through activity regularization

Imbalance Mitigation for Continual Learning via Knowledge Decoupling and Dual Enhanced Contrastive Learning

Balancing Stability and Plasticity Through Advanced Null Space in Continual Learning

Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Model