Controllable and Diverse Data Augmentation with Large Language Model for Low-Resource Open-Domain Dialogue Generation

Zhenhua Liu,Tong Zhu,Jianxiang Xiang,Wenliang Chen

2024-03-30

Abstract:Data augmentation (DA) is crucial to mitigate model training instability and over-fitting problems in low-resource open-domain dialogue generation. However, traditional DA methods often neglect semantic data diversity, restricting the overall quality. Recently, large language models (LLM) have been used for DA to generate diversified dialogues. However, they have limited controllability and tend to generate dialogues with a distribution shift compared to the seed dialogues. To maximize the augmentation diversity and address the controllability problem, we propose \textbf{S}ummary-based \textbf{D}ialogue \textbf{A}ugmentation with LLM (SDA). Our approach enhances the controllability of LLM by using dialogue summaries as a planning tool. Based on summaries, SDA can generate high-quality and diverse dialogue data even with a small seed dataset. To evaluate the efficacy of data augmentation methods for open-domain dialogue, we designed a clustering-based metric to characterize the semantic diversity of the augmented dialogue data. The experimental results show that SDA can augment high-quality and semantically diverse dialogues given a small seed dataset and an LLM, and the augmented data can boost the performance of open-domain dialogue models.

Computation and Language

What problem does this paper attempt to address?

The paper attempts to address the issue of how data augmentation methods can improve the diversity of dialogue data while maintaining the quality and consistency of the dialogue distribution in low-resource open-domain dialogue generation. Traditional data augmentation methods often overlook the diversity of semantic data, limiting overall quality; whereas existing large language models (LLMs) can generate diverse dialogues, their controllability is limited, and the distribution of generated dialogues may deviate from the seed dialogues. Therefore, this study proposes a dialogue augmentation method based on dialogue summaries (SDA), aiming to maximize the diversity of augmented data and address controllability issues. By using dialogue summaries as planning tools, SDA can generate high-quality and diverse dialogue data on a small-scale seed dataset. Additionally, to evaluate the effectiveness of the data augmentation method, the researchers designed a clustering-based metric to characterize the semantic diversity of the augmented dialogue data. Experimental results show that SDA can effectively enhance high-quality and semantically diverse dialogues given a small-scale seed dataset and a large language model, thereby improving the performance of open-domain dialogue generation models.

Controllable and Diverse Data Augmentation with Large Language Model for Low-Resource Open-Domain Dialogue Generation

A Unified Data Augmentation Framework for Low-Resource Multi-Domain Dialogue Generation

Learning Towards Selective Data Augmentation for Dialogue Generation.

Data Augmentation Integrating Dialogue Flow and Style to Adapt Spoken Dialogue Systems to Low-Resource User Groups

LLM–Assisted Data Augmentation for Chinese Dialogue–Level Dependency Parsing

Plan, Generate and Complicate: Improving Low-resource Dialogue State Tracking via Easy-to-Difficult Zero-shot Data Augmentation

Data Augmentation using Large Language Models: Data Perspectives, Learning Paradigms and Challenges

Sequence-to-Sequence Data Augmentation for Dialogue Language Understanding.

Insufficient Data Can Also Rock！Learning to Converse Using Smaller Data with Augmentation

Multi-source inverse-curriculum-based training for low-resource dialogue generation

Effective Data Augmentation Approaches to End-to-End Task-Oriented Dialogue

DFlow: Diverse Dialogue Flow Simulation with Large Language Models

A Unified Dialogue User Simulator for Few-shot Data Augmentation

Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks

Data Augmentation of Multi-turn Psychological Dialogue via Knowledge-driven Progressive Thought Prompting

Data Augmentation for Low‐resource Languages NMT Guided by Constrained Sampling

Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data

DALDA: Data Augmentation Leveraging Diffusion Model and LLM with Adaptive Guidance Scaling

An Effective Deployment of Diffusion LM for Data Augmentation in Low-Resource Sentiment Classification

Towards Efficiently Diversifying Dialogue Generation Via Embedding Augmentation

LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition