Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias

Yue Yu,Yuchen Zhuang,Jieyu Zhang,Yu Meng,Alexander Ratner,Ranjay Krishna,Jiaming Shen,Chao Zhang

2023-10-18

Abstract:Large language models (LLMs) have been recently leveraged as training data generators for various natural language processing (NLP) tasks. While previous research has explored different approaches to training models using generated data, they generally rely on simple class-conditional prompts, which may limit the diversity of the generated data and inherit systematic biases of LLM. Thus, we investigate training data generation with diversely attributed prompts (e.g., specifying attributes like length and style), which have the potential to yield diverse and attributed generated data. Our investigation focuses on datasets with high cardinality and diverse domains, wherein we demonstrate that attributed prompts outperform simple class-conditional prompts in terms of the resulting model's performance. Additionally, we present a comprehensive empirical study on data generation encompassing vital aspects like bias, diversity, and efficiency, and highlight three key observations: firstly, synthetic datasets generated by simple prompts exhibit significant biases, such as regional bias; secondly, attribute diversity plays a pivotal role in enhancing model performance; lastly, attributed prompts achieve the performance of simple class-conditional prompts while utilizing only 5\% of the querying cost of ChatGPT associated with the latter. The data and code are available on \url{<a class="link-external link-https" href="https://github.com/yueyu1030/AttrPrompt" rel="external noopener nofollow">this https URL</a>}.

Computation and Language,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The paper primarily aims to address the following issues:

1. **Insufficient diversity in generated data**: Existing large language models (LLMs) typically rely on simple class-conditional prompts when generating training data, which may lead to insufficient diversity in the generated data and inherit systematic biases present in LLMs.

2. **Role of attribute diversity**: Researchers explored the impact of attributed prompts with different attributes (such as length, style, etc.) on generated data and found that these diversified prompts can significantly improve the performance of downstream task models.

3. **Reducing bias and enhancing diversity**: A new method, AttrPrompt, is proposed to generate more diverse training data by combining multiple attributes, thereby mitigating regional and other biases present in data generated by simple prompts.

The paper validates the effectiveness of AttrPrompt through multiple experiments, particularly on high-cardinality and diversified datasets, where it outperforms traditional simple class-conditional prompts (SimPrompt). Additionally, AttrPrompt demonstrates cost-efficiency advantages, achieving the same effect as SimPrompt with only 5% of the ChatGPT query cost.