Abstract:Large language models (LMs) are typically adapted to improve performance on new contexts (\eg text prompts that define new tasks or domains) through fine-tuning or prompting. However, there is an accuracy compute tradeoff -- fine-tuning incurs significant training cost and prompting increases inference overhead. We introduce $GenerativeAdapter$, an effective and efficient adaptation method that directly maps new contexts to low-rank LM adapters, thereby significantly reducing inference overhead with no need for finetuning. The adapter generator is trained via self-supervised learning, and can be used to adapt a single frozen LM for any new task simply by mapping the associated task or domain context to a new adapter. We apply $GenerativeAdapter$ to two pretrained LMs (Mistral-7B-Instruct and Llama2-7B-Chat) and evaluate the adapted models in three adaption scenarios: knowledge acquisition from documents, learning from demonstrations, and personalization for users. In StreamingQA, our approach is effective in injecting knowledge into the LM's parameters, achieving a 63.5% improvement in F1 score over the model with supervised fine-tuning (from $19.5$ to $31.5$) for contexts as long as 32K tokens. In the MetaICL in-context learning evaluation, our method achieves an average accuracy of $44.9$ across 26 tasks, outperforming the base model. On MSC, our method proves to be highly competitive in memorizing user information from conversations with a 4x reduction in computation and memory costs compared to prompting with full conversation history. Together, these results suggest that $GenerativeAdapter$ should allow for general adaption to a wide range of different contexts.

TADA: Task-Agnostic Dialect Adapters for English

DADA: Dialect Adaptation via Dynamic Aggregation of Linguistic Rules

Task-Agnostic Low-Rank Adapters for Unseen English Dialects

TADA: Efficient Task-Agnostic Domain Adaptation for Transformers

Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters

Cross-Lingual Transfer with Target Language-Ready Task Adapters

Data-Augmentation-Based Dialectal Adaptation for LLMs

Predicting the Target Word of Game-playing Conversations using a Low-Rank Dialect Adapter for Decoder Models

Adapters for Altering LLM Vocabularies: What Languages Benefit the Most?

Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation

ADaPT: As-Needed Decomposition and Planning with Language Models

One Language, Many Gaps: Evaluating Dialect Fairness and Robustness of Large Language Models in Reasoning Tasks

TOAD: Task-Oriented Automatic Dialogs with Diverse Response Styles

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass

Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue System

AdaMergeX: Cross-Lingual Transfer with Large Language Models via Adaptive Adapter Merging

VALUE: Understanding Dialect Disparity in NLU

Methodology of Adapting Large English Language Models for Specific Cultural Contexts

Evaluating Dialect Robustness of Language Models via Conversation Understanding

Test-time Alignment-Enhanced Adapter for Vision-Language Models

No Train but Gain: Language Arithmetic for training-free Language Adapters enhancement