Abstract:Data-to-text generation plays an important role in natural language processing by processing structured data and helping people understand those data by generating user-friendly descriptive text. It can be applied to news generation, financial report generation, customer service, etc. However, in practice, it needs to adapt to different domains that may lack an annotated training corpus. To alleviate this dataset scarcity problem, distantly-supervised data-to-text generation has emerged, which constructs a training corpus automatically and is more practical to apply to new domains when well-aligned data is expensive to obtain. However, this distant supervision method of training induces an over-generation problem since the automatically aligned text includes hallucination. These expressions cannot be inferred from the data, misguiding the model to produce unfaithful text. To exploit the noisy dataset while maintaining faithfulness, we empower the neural data-to-text model by dynamically increasing the weights of those well-aligned training instances and reducing the weights of the low-quality ones via meta learning. To our best knowledge, we are the first to alleviate the noise in distantly-supervised data-to-text generation via meta learning. In addition, we rewrite those low-quality texts to provide better training instances. Finally, we construct a new distantly-supervised dataset, DIST-ToTTo (abbreviation for Distantly-supervised Table-To-Text), and conduct experiments on both the benchmark WITA (abbreviation for the data source Wikipedia and Wikidata) and DIST-ToTTo datasets. The evaluation results show that our model can improve the state-of-the-art DSG (abbreviation for Distant Supervision Generation) model across all automatic evaluation metrics, with an improvement of 3.72% on the WITA dataset and 3.82% on the DIST-ToTTo dataset in terms of the widely used metric BLEU (abbreviation for BiLingual Evaluation Understudy). Furthermore, based on human evaluation, our model can generate more grammatically correct and more faithful text compared to the state-of-the-art DSG model.

CMMQC: Cascaded Multi-Model Quality Control for Unsupervised Data-to-Text Generation

Quality Control for Distantly-Supervised Data-to-Text Generation Via Meta Learning

Data Quality Enhancement on the Basis of Diversity with Large Language Models for Text Classification: Uncovered, Difficult, and Noisy

UniGen: A Unified Framework for Textual Dataset Generation Using Large Language Models

Unveiling Large Language Models Generated Texts: A Multi-Level Fine-Grained Detection Framework

Text2Data: Low-Resource Data Generation with Textual Control

Controlled Text Generation for Large Language Model with Dynamic Attribute Graphs

A Semi-Supervised Approach for Low-Resourced Text Generation.

Teach LLMs to Personalize -- An Approach inspired by Writing Education

Beyond Traditional Benchmarks: Analyzing Behaviors of Open LLMs on Data-to-Text Generation

Controllable Text Generation for Large Language Models: A Survey

Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs

A Lightweight Multi Aspect Controlled Text Generation Solution For Large Language Models

Curriculum Learning with Quality-Driven Data Selection

Exploration of Masked and Causal Language Modelling for Text Generation

Partially-Aligned Data-to-Text Generation with Distant Supervision

Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation

Unlocking Anticipatory Text Generation: A Constrained Approach for Large Language Models Decoding

How Do Seq2Seq Models Perform on End-to-End Data-to-Text Generation?

T2I-Scorer: Quantitative Evaluation on Text-to-Image Generation Via Fine-Tuned Large Multi-Modal Models

TextMachina: Seamless Generation of Machine-Generated Text Datasets