Abstract:Data-to-text generation plays an important role in natural language processing by processing structured data and helping people understand those data by generating user-friendly descriptive text. It can be applied to news generation, financial report generation, customer service, etc. However, in practice, it needs to adapt to different domains that may lack an annotated training corpus. To alleviate this dataset scarcity problem, distantly-supervised data-to-text generation has emerged, which constructs a training corpus automatically and is more practical to apply to new domains when well-aligned data is expensive to obtain. However, this distant supervision method of training induces an over-generation problem since the automatically aligned text includes hallucination. These expressions cannot be inferred from the data, misguiding the model to produce unfaithful text. To exploit the noisy dataset while maintaining faithfulness, we empower the neural data-to-text model by dynamically increasing the weights of those well-aligned training instances and reducing the weights of the low-quality ones via meta learning. To our best knowledge, we are the first to alleviate the noise in distantly-supervised data-to-text generation via meta learning. In addition, we rewrite those low-quality texts to provide better training instances. Finally, we construct a new distantly-supervised dataset, DIST-ToTTo (abbreviation for Distantly-supervised Table-To-Text), and conduct experiments on both the benchmark WITA (abbreviation for the data source Wikipedia and Wikidata) and DIST-ToTTo datasets. The evaluation results show that our model can improve the state-of-the-art DSG (abbreviation for Distant Supervision Generation) model across all automatic evaluation metrics, with an improvement of 3.72% on the WITA dataset and 3.82% on the DIST-ToTTo dataset in terms of the widely used metric BLEU (abbreviation for BiLingual Evaluation Understudy). Furthermore, based on human evaluation, our model can generate more grammatically correct and more faithful text compared to the state-of-the-art DSG model.

TGEA: an Error-Annotated Dataset and Benchmark Tasks for TextGeneration from Pretrained Language Models

GLGE: A New General Language Generation Evaluation Benchmark

TransGEC: Improving Grammatical Error Correction with Translationese

TeGit: Generating High-Quality Instruction-Tuning Data with Text-Grounded Task Design

Efficient Grammatical Error Correction Via Multi-Task Training and Optimized Training Schedule

TEG-DB: A Comprehensive Dataset and Benchmark of Textual-Edge Graphs

Generating Textual Entailment Using Residual Lstms

Quality Control for Distantly-Supervised Data-to-Text Generation Via Meta Learning

CT-Eval: Benchmarking Chinese Text-to-Table Performance in Large Language Models

DTGB: A Comprehensive Benchmark for Dynamic Text-Attributed Graphs

HWCGEC:HW-TSC's 2023 Submission for the NLPCC2023's Chinese Grammatical Error Correction Task.

TableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content Matching

TEGTOK: Augmenting Text Generation Via Task-specific and Open-world Knowledge

TEGEE: Task dEfinition Guided Expert Ensembling for Generalizable and Few-shot Learning

TWT: Table with Written Text for Controlled Data-to-Text Generation

A Benchmark for Text Expansion: Datasets, Metrics, and Baselines.

MTG: A Benchmark Suite for Multilingual Text Generation.

Shared Task on Evaluating Accuracy in Natural Language Generation

LeTI: Learning to Generate from Textual Interactions

TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generation

JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs