Abstract:As large language models (LLMs) become increasingly advanced, their ability to exhibit compositional generalization -- the capacity to combine learned skills in novel ways not encountered during training -- has garnered significant attention. This type of generalization, particularly in scenarios beyond training data, is also of great interest in the study of AI safety and alignment. A recent study introduced the SKILL-MIX evaluation, where models are tasked with composing a short paragraph demonstrating the use of a specified $k$-tuple of language skills. While small models struggled with composing even with $k=3$, larger models like GPT-4 performed reasonably well with $k=5$ and $6$. In this paper, we employ a setup akin to SKILL-MIX to evaluate the capacity of smaller models to learn compositional generalization from examples. Utilizing a diverse set of language skills -- including rhetorical, literary, reasoning, theory of mind, and common sense -- GPT-4 was used to generate text samples that exhibit random subsets of $k$ skills. Subsequent fine-tuning of 7B and 13B parameter models on these combined skill texts, for increasing values of $k$, revealed the following findings: (1) Training on combinations of $k=2$ and $3$ skills results in noticeable improvements in the ability to compose texts with $k=4$ and $5$ skills, despite models never having seen such examples during training. (2) When skill categories are split into training and held-out groups, models significantly improve at composing texts with held-out skills during testing despite having only seen training skills during fine-tuning, illustrating the efficacy of the training approach even with previously unseen skills. This study also suggests that incorporating skill-rich (potentially synthetic) text into training can substantially enhance the compositional capabilities of models.

Limits of Transformer Language Models on Learning to Compose Algorithms

Faith and Fate: Limits of Transformers on Compositionality

Do Large Language Models Have Compositional Ability? An Investigation into Limitations and Scalability

When can transformers compositionally generalize in-context?

Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks

Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models

The Impact of Depth on Compositional Generalization in Transformer Language Models

Exposing Limitations of Language Model Agents in Sequential-Task Compositions on the Web

On Task-Level Dialogue Composition of Generative Transformer Model

Out-of-distribution generalization via composition: a lens through induction heads in Transformers

Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theory

Can Models Learn Skill Composition from Examples?

Evaluating Morphological Compositional Generalization in Large Language Models

Learning to Perform Complex Tasks through Compositional Fine-Tuning of Language Models

Understanding In-Context Learning in Transformers and LLMs by Learning to Learn Discrete Functions

What makes Models Compositional? A Theoretical View: With Supplement

From Words to Worlds: Compositionality for Cognitive Architectures

Towards Understanding the Relationship between In-context Learning and Compositional Generalization

Compositional learning of functions in humans and machines

Re-Tuning: Overcoming the Compositionality Limits of Large Language Models with Recursive Tuning

Interpreting token compositionality in LLMs: A robustness analysis