Abstract:Paraphrase generation reflects the ability to understand the meaning from the language surface form and rephrase it to other expressions.Recent paraphrase generation works have paid attention to unsupervised approaches based on Pre-trained Language Models (PLMs) to avoid heavy reliance on parallel data by utilizing PLMs' generation ability.However, the generated pairs of existing unsupervised methods are usually weak either in semantic equivalence or expression diversity.In this paper, we present a novel unsupervised paraphrase generation framework called Paraphrase Machine.By employing multi-aspect equivalence constraints and multi-granularity diversifying mechanisms, Paraphrase Machine is able to achieve good semantic equivalence and expressive diversity, producing a high-quality unsupervised paraphrase dataset.Based on this dataset, we train a general paraphrase model, which can be directly applied to rewrite the input sentence of various domains without any fine-tuning, and achieves substantial gains of 9.1% and 3.3% absolutely in BLEU score over previous SOTA on Quora and MSCOCO.By further fine-tuning our model with domain-specific training sets, the improvement can be increased to even 18.0% and 4.6%.Most importantly, by applying it to language understanding and generation tasks under the low-resource setting, we demonstrate that our model can serve as a universal data augmentor to boost the few-shot performance (e.g., average 2.0% gain on GLUE).Code and data can be found at https://github.com/Matthewlliu/UnsupervisedParaphrase.

From Paraphrasing to Semantic Parsing: Unsupervised Semantic Parsing Via Synchronous Semantic Decoding

Unsupervised Dual Paraphrasing for Two-stage Semantic Parsing

Enhancing Unsupervised Semantic Parsing with Distributed Contextual Representations

Unifying Discrete and Continuous Representations for Unsupervised Paraphrase Generation

Data Synthesis and Iterative Refinement for Neural Semantic Parsing without Annotated Logical Forms.

Dependency to Semantics: Structure Transformation and Syntax-Guided Attention for Neural Semantic Parsing.

Unsupervised Paraphrasing by Simulated Annealing

Bridging the Gap Between Synthetic and Natural Questions Via Sentence Decomposition for Semantic Parsing

Sentence Rewriting for Semantic Parsing

Unsupervised Disentanglement Learning Model for Exemplar-Guided Paraphrase Generation

Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm

ParaMac: A General Unsupervised Paraphrase Generation Framework Leveraging Semantic Constraints and Diversifying Mechanisms.

Coarse-to-Fine Decoding for Neural Semantic Parsing

Integrative Semantic Dependency Parsing Via Efficient Large-Scale Feature Selection

Conversational Semantic Parsing

Semantic Parsing for English as a Second Language

Schema-Free Dependency Parsing via Sequence Generation

Shallow Semantic Parsing Research

Discourse Representation Structure Parsing for Chinese

Semantics-Driven Shallow Parsing for Chinese Semantic Role Labeling.

Unsupervised Paraphrasing under Syntax Knowledge