Abstract:Model editing aims to correct outdated or erroneous knowledge in large language models (LLMs) without the need for costly retraining. Lifelong model editing is the most challenging task that caters to the continuous editing requirements of LLMs. Prior works primarily focus on single or batch editing; nevertheless, these methods fall short in lifelong editing scenarios due to catastrophic knowledge forgetting and the degradation of model performance. Although retrieval-based methods alleviate these issues, they are impeded by slow and cumbersome processes of integrating the retrieved knowledge into the model. In this work, we introduce RECIPE, a RetriEval-augmented ContInuous Prompt lEarning method, to boost editing efficacy and inference efficiency in lifelong learning. RECIPE first converts knowledge statements into short and informative continuous prompts, prefixed to the LLM's input query embedding, to efficiently refine the response grounded on the knowledge. It further integrates the Knowledge Sentinel (KS) that acts as an intermediary to calculate a dynamic threshold, determining whether the retrieval repository contains relevant knowledge. Our retriever and prompt encoder are jointly trained to achieve editing properties, i.e., reliability, generality, and locality. In our experiments, RECIPE is assessed extensively across multiple LLMs and editing datasets, where it achieves superior editing performance. RECIPE also demonstrates its capability to maintain the overall performance of LLMs alongside showcasing fast editing and inference speed.

Discovering Editing Rules by Deep Reinforcement Learning.

Discovering Denial Constraints Based on Deep Reinforcement Learning

AdaRefiner: Refining Decisions of Language Models with Adaptive Feedback

Rule mining over knowledge graphs via reinforcement learning

Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint

Ruleformer: Context-aware Rule Mining over Knowledge Graph.

Reasoning Makes Good Annotators : an Automatic Task-specific Rules Distilling Framework for Low-resource Relation Extraction

MetaRule: A Meta-path Guided Ensemble Rule Set Learning for Explainable Fraud Detection.

Distilling Task-specific Logical Rules from Large Pre-trained Models

Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoning

An Adaptive Framework for Confidence-constraint Rule Set Learning Algorithm in Large Dataset

When Mining Electric Locomotives Meet Reinforcement Learning

Constraint-Adaptive Rule Mining in Large Databases

ChatRule: Mining Logical Rules with Large Language Models for Knowledge Graph Reasoning

Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learning

RuleR: Improving LLM Controllability by Rule-based Data Recycling

Deep Explainable Learning with Graph Based Data Assessing and Rule Reasoning

LR-MS: a Mining System for Local Temporal Rules

Leveraging Logical Rules in Knowledge Editing: A Cherry on the Top

Robust and Scalable Model Editing for Large Language Models

Improving rule mining via embedding-based link prediction