Abstract:Paraphrase generation reflects the ability to understand the meaning from the language surface form and rephrase it to other expressions.Recent paraphrase generation works have paid attention to unsupervised approaches based on Pre-trained Language Models (PLMs) to avoid heavy reliance on parallel data by utilizing PLMs' generation ability.However, the generated pairs of existing unsupervised methods are usually weak either in semantic equivalence or expression diversity.In this paper, we present a novel unsupervised paraphrase generation framework called Paraphrase Machine.By employing multi-aspect equivalence constraints and multi-granularity diversifying mechanisms, Paraphrase Machine is able to achieve good semantic equivalence and expressive diversity, producing a high-quality unsupervised paraphrase dataset.Based on this dataset, we train a general paraphrase model, which can be directly applied to rewrite the input sentence of various domains without any fine-tuning, and achieves substantial gains of 9.1% and 3.3% absolutely in BLEU score over previous SOTA on Quora and MSCOCO.By further fine-tuning our model with domain-specific training sets, the improvement can be increased to even 18.0% and 4.6%.Most importantly, by applying it to language understanding and generation tasks under the low-resource setting, we demonstrate that our model can serve as a universal data augmentor to boost the few-shot performance (e.g., average 2.0% gain on GLUE).Code and data can be found at https://github.com/Matthewlliu/UnsupervisedParaphrase.

Unsupervised Paraphrasing of Multiword Expressions

Unsupervised Paraphrasing by Simulated Annealing

ParaMac: A General Unsupervised Paraphrase Generation Framework Leveraging Semantic Constraints and Diversifying Mechanisms.

Paraphrase Generation As Unsupervised Machine Translation.

Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation

WORD EMBEDDING ATTENTION NETWORK: GENERATING WORDS BY QUERYING DISTRIBUTED WORD REPRESENTATIONS FOR PARAPHRASE GENERATION

Extracting paraphrases from a parallel corpus

Unsupervised Dual Paraphrasing for Two-stage Semantic Parsing

Enriching SMT Training Data Via Paraphrasing.

Sentence-Level Paraphrasing for Machine Translation System Combination.

Paraphrase Identification Based on Weighted URAE, Unit Similarity and Context Correlation Feature.

Unsupervised Lexical Simplification with Context Augmentation

Paraphrase based similar expression generation

Multilingual Lexical Simplification via Paraphrase Generation

ECNU: Leveraging Word Embeddings to Boost Performance for Paraphrase in Twitter.

Parse-realize based paraphrasing and SMT corpus enriching

Automatic Acquisition of Context-Specific Lexical Paraphrases

Web mining for lexical context-specific paraphrasing

BERT(s) to Detect Multiword Expressions

Lexical Paraphrasing Based on Automatically Constructed Corpora

Unsupervised Disentanglement Learning Model for Exemplar-Guided Paraphrase Generation