Abstract:As the applications of large language models (LLMs) expand across diverse fields, the ability of these models to adapt to ongoing changes in data, tasks, and user preferences becomes crucial. Traditional training methods, relying on static datasets, are increasingly inadequate for coping with the dynamic nature of real-world information. Lifelong learning, also known as continual or incremental learning, addresses this challenge by enabling LLMs to learn continuously and adaptively over their operational lifetime, integrating new knowledge while retaining previously learned information and preventing catastrophic forgetting. This survey delves into the sophisticated landscape of lifelong learning, categorizing strategies into two primary groups: Internal Knowledge and External Knowledge. Internal Knowledge includes continual pretraining and continual finetuning, each enhancing the adaptability of LLMs in various scenarios. External Knowledge encompasses retrieval-based and tool-based lifelong learning, leveraging external data sources and computational tools to extend the model's capabilities without modifying core parameters. The key contributions of our survey are: (1) Introducing a novel taxonomy categorizing the extensive literature of lifelong learning into 12 scenarios; (2) Identifying common techniques across all lifelong learning scenarios and classifying existing literature into various technique groups within each scenario; (3) Highlighting emerging techniques such as model expansion and data selection, which were less explored in the pre-LLM era. Through a detailed examination of these groups and their respective categories, this survey aims to enhance the adaptability, reliability, and overall performance of LLMs in real-world applications.

LAMAL: LAnguage Modeling is All You Need for Lifelong Language Learning

LAMOL: LAnguage MOdeling for Lifelong Language Learning.

Towards Lifelong Learning of Large Language Models: A Survey

RVAE-LAMOL: Residual Variational Autoencoder to Enhance Lifelong Language Learning

Towards Practical Tool Usage for Continually Learning LLMs

Small LLMs Are Weak Tool Learners: A Multi-LLM Agent

Online Continual Knowledge Learning for Language Models

Continual Learning for Large Language Models: A Survey

Lifelong Robot Learning with Human Assisted Language Planners

Continual Learning Using Only Large Language Model Prompting

PAL: Program-aided Language Models

Large Language Models with Controllable Working Memory

Large language model programs

Simple and Scalable Strategies to Continually Pre-train Large Language Models

From Goal-Conditioned to Language-Conditioned Agents via Vision-Language Models

Improving Multimodal Large Language Models Using Continual Learning

Less is More: Pre-Training Cross-Lingual Small-Scale Language Models with Cognitively-Plausible Curriculum Learning Strategies

MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning

Large Language Models Demonstrate the Potential of Statistical Learning in Language

Learning to Decode Collaboratively with Multiple Language Models