Generating Sentences by Editing Prototypes

Kelvin Guu,Tatsunori B. Hashimoto,Yonatan Oren,Percy Liang
DOI: https://doi.org/10.48550/arXiv.1709.08878
2018-09-07
Abstract:We propose a new generative model of sentences that first samples a prototype sentence from the training corpus and then edits it into a new sentence. Compared to traditional models that generate from scratch either left-to-right or by first sampling a latent sentence vector, our prototype-then-edit model improves perplexity on language modeling and generates higher quality outputs according to human evaluation. Furthermore, the model gives rise to a latent edit vector that captures interpretable semantics such as sentence similarity and sentence-level analogies.
Computation and Language,Artificial Intelligence,Machine Learning,Neural and Evolutionary Computing
What problem does this paper attempt to address?