Abstract:As large language models achieve increasingly impressive results, questions arise about whether such performance is from generalizability or mere data memorization. Thus, numerous data contamination detection methods have been proposed. However, these approaches are often validated with traditional benchmarks and early-stage LLMs, leaving uncertainty about their effectiveness when evaluating state-of-the-art LLMs on the contamination of more challenging benchmarks. To address this gap and provide a dual investigation of SOTA LLM contamination status and detection method robustness, we evaluate five contamination detection approaches with four state-of-the-art LLMs across eight challenging datasets often used in modern LLM evaluation. Our analysis reveals that (1) Current methods have non-trivial limitations in their assumptions and practical applications; (2) Notable difficulties exist in detecting contamination introduced during instruction fine-tuning with answer augmentation; and (3) Limited consistencies between SOTA contamination detection techniques. These findings highlight the complexity of contamination detection in advanced LLMs and the urgent need for further research on robust and generalizable contamination evaluation. Our code is available at <a class="link-external link-https" href="https://github.com/vsamuel2003/data-contamination" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the limitations and challenges of large - language models (LLMs) in data - contamination detection. As large - language models achieve increasingly impressive results in various benchmark tests, people begin to question whether these performance improvements are due to the generalization ability of the models or simply the data - memorization ability. Therefore, many data - contamination - detection methods have been proposed, but these methods are usually verified on traditional benchmarks and early - stage LLMs, which leads to uncertainty about their effectiveness in evaluating the latest LLMs, especially when dealing with more challenging benchmarks. In addition, existing research mainly focuses on data - contamination detection in the pre - training stage, ignoring the possible data variations introduced in the instruction - fine - tuning stage, which may cause difficulties for contamination detection. By evaluating the performance of five data - contamination - detection methods on four state - of - the - art LLMs, the paper aims to fill this gap and provide an in - depth analysis of current contamination - detection techniques. Specifically, the paper attempts to answer the following research questions: 1. Are the latest state - of - the - art LLMs affected by these challenging benchmarks? What results do the detection methods show? 2. Can these methods detect contamination that occurs in the form of data variations different from the original format in pre - training during the instruction - fine - tuning process? 3. Are the findings of different "widely - recognized" detection methods consistent for a given dataset? Will they produce inconsistent results? Through the exploration of these questions, the paper reveals the limitations of current data - contamination - detection methods in assumptions and practical applications, especially the difficulties in dealing with complex datasets and advanced LLMs, emphasizing the urgency of further research.

Towards Data Contamination Detection for Modern Large Language Models: Limitations, Inconsistencies, and Oracle Challenges

Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptions

Data Contamination Can Cross Language Barriers

Unveiling the Spectrum of Data Contamination in Language Models: A Survey from Detection to Remediation

Evaluation data contamination in LLMs: how do we measure it and (when) does it matter?

Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models

How Much are Large Language Models Contaminated? A Comprehensive Survey and the LLMSanitize Library

Time Travel in LLMs: Tracing Data Contamination in Large Language Models

An Open Source Data Contamination Report for Large Language Models

Data Contamination Through the Lens of Time

A Taxonomy for Data Contamination in Large Language Models

Investigating Data Contamination in Modern Benchmarks for Large Language Models

Investigating Data Contamination for Pre-training Language Models

CAP: Data Contamination Detection via Consistency Amplification

Quantifying Contamination in Evaluating Code Generation Capabilities of Language Models

Benchmark Data Contamination of Large Language Models: A Survey

Contamination Report for Multilingual Benchmarks

Concerned with Data Contamination? Assessing Countermeasures in Code Language Model

Data Contamination Calibration for Black-box LLMs

CLEAN-EVAL: Clean Evaluation on Contaminated Large Language Models

NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark