Abstract:The aim of Logic2Text is to generate controllable and faithful texts conditioned on tables and logical forms, which not only requires a deep understanding of the tables and logical forms, but also warrants symbolic reasoning over the tables. State-of-the-art methods based on pre-trained models have achieved remarkable performance on the standard test dataset. However, we question whether these methods really learn how to perform logical reasoning, rather than just relying on the spurious correlations between the headers of the tables and operators of the logical form. To verify this hypothesis, we manually construct a set of counterfactual samples, which modify the original logical forms to generate counterfactual logical forms with rarely co-occurred table headers and logical operators. SOTA methods give much worse results on these counterfactual samples compared with the results on the original test dataset, which verifies our hypothesis. To deal with this problem, we firstly analyze this bias from a causal perspective, based on which we propose two approaches to reduce the model's reliance on the shortcut. The first one incorporates the hierarchical structure of the logical forms into the model. The second one exploits automatically generated counterfactual data for training. Automatic and manual experimental results on the original test dataset and the counterfactual dataset show that our method is effective to alleviate the spurious correlation. Our work points out the weakness of previous methods and takes a further step toward developing Logic2Text models with real logical reasoning ability.

LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training.

Improving Logical-Level Natural Language Generation with Topic-Conditioned Data Augmentation and Logical Form Generation

Investigating the Robustness of Natural Language Generation from Logical Forms Via Counterfactual Samples

Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Models

Few-shot Natural Language Generation for Task-Oriented Dialog

SP-NLG: A Semantic-Parsing-Guided Natural Language Generation Framework

PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation

Adapting Knowledge for Few-shot Table-to-Text Generation

Few-Shot Table-to-Text Generation with Prompt Planning and Knowledge Memorization

Select, Extend, and Generate: Generative Knowledge Selection for Open-Domain Dialogue Response Generation.

AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentation

Planning with Logical Graph-based Language Model for Instruction Generation

Towards information-rich, logical text generation with knowledge-enhanced neural models

Guided Knowledge Generation with Language Models for Commonsense Reasoning

Generation-driven Contrastive Self-training for Zero-shot Text Classification with Instruction-following LLM

Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach

LogicalDefender: Discovering, Extracting, and Utilizing Common-Sense Knowledge

LLM-based MOFs Synthesis Condition Extraction using Few-Shot Demonstrations

Optimizing Factual Accuracy in Text Generation Through Dynamic Knowledge Selection

Zero-shot Knowledge Graph Question Generation Via Multi-agent LLMs and Small Models Synthesis

In Search of the Long-Tail: Systematic Generation of Long-Tail Inferential Knowledge via Logical Rule Guided Search