Abstract:What happens if we train a new Large Language Model (LLM) using data that are at least partially generated by other LLMs? The explosive success of LLMs means that a substantial amount of content online will be generated by LLMs rather than humans, which will inevitably enter the training datasets of next-generation LLMs. We evaluate the implications of such "regurgitative training" on LLM performance. Through fine-tuning GPT-3.5 with data generated either by itself or by other LLMs in a machine translation task, we find strong evidence that regurgitative training clearly handicaps the performance of LLMs. The same performance loss of regurgitative training is observed on transformer models that we train from scratch. We find suggestive evidence that the performance disadvantage of regurgitative training can be attributed to at least two mechanisms: (1) higher error rates and (2) lower lexical diversity in LLM-generated data as compared to real data. Based on these mechanisms, we propose and evaluate three different strategies to mitigate the performance loss of regurgitative training. First, we devise data-driven metrics to gauge the quality of each LLM-generated data instance, and then carry out an ordered training process where high-quality data are added before low-quality ones. Second, we combine data generated by multiple different LLMs (as an attempt to increase lexical diversity). Third, we train an AI detection classifier to differentiate between LLM- and human-generated data, and include LLM-generated data in the order of resemblance to human-generated data. All three strategies can improve the performance of regurgitative training to some extent but are not always able to fully close the gap from training with real data. Our results highlight the value of real, human-generated data in training LLMs, which cannot be easily substituted by synthetic, LLM-generated data.

Do Language Models Plagiarize?

PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection

FOCUS: Forging Originality through Contrastive Use in Self-Plagiarism for Language Models

How Large Language Models are Transforming Machine-Paraphrased Plagiarism

LLMs Plagiarize: Ensuring Responsible Sourcing of Large Language Model Training Data Through Knowledge Graph Comparison

Copyright Violations and Large Language Models

Survey on Plagiarism Detection in Large Language Models: The Impact of ChatGPT and Gemini on Academic Integrity

Survey on AI-Generated Plagiarism Detection: the Impact of Large Language Models on Academic Integrity

Exploring Memorization and Copyright Violation in Frontier LLMs: A Study of the New York Times v. OpenAI 2023 Lawsuit

Paraphrase Identification with Deep Learning: A Review of Datasets and Methods

Identifying Machine-Paraphrased Plagiarism

Matching Pairs: Attributing Fine-Tuned Models to their Pre-Trained Large Language Models

Do Language Models Know When They're Hallucinating References?

Detecting Cross-Lingual Plagiarism Using Simulated Word Embeddings

Quantifying Memorization and Detecting Training Data of Pre-trained Language Models using Japanese Newspaper

LLMs and Memorization: On Quality and Specificity of Copyright Compliance

Beyond Black Box AI-Generated Plagiarism Detection: From Sentence to Document Level

A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Texts

Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Regurgitative Training: The Value of Real Data in Training Large Language Models

Copyright Traps for Large Language Models