Abstract:Neural language models based on recurrent neural networks (RNNLM) have significantly improved the performance for text generation, yet the quality of generated text represented by Turing Test pass rate is still far from satisfying. Some researchers propose to use adversarial training or reinforcement learning to promote the quality, however, such methods usually introduce great challenges in the training and parameter tuning processes. Through our analysis, we find the problem of RNNLM comes from the usage of maximum likelihood estimation (MLE) as the objective function, which requires the generated distribution to precisely recover the true distribution. Such requirement favors high generation diversity which restricted the generation quality. This is not suitable when the overall quality is low, since high generation diversity usually indicates lot of errors rather than diverse good samples. In this paper, we propose to achieve differentiated distribution recovery, DDR for short. The key idea is to make the optimal generation probability proportional to the β-th power of the true probability, where β > 1. In this way, the generation quality can be greatly improved by sacrificing diversity from noises and rare patterns. Experiments on synthetic data and two public text datasets show that our DDR method achieves more flexible quality-diversity trade-off and higher Turing Test pass rate, as compared with baseline methods including RNNLM, SeqGAN and LeakGAN.

Improve the Diversity and Novelty for Open-Ended Neural Text Generation via Inverse Probability Weighting.

Penalizing the High-likelihood: A Novel Sampling Method for Open-ended Neural Text Generation via Inverse Probability Weighting

Improving Diversity of Neural Text Generation Via Inverse Probability Weighting

A Simple, Fast Diverse Decoding Algorithm for Neural Generation

Diversifying Neural Text Generation with Part-of-Speech Guided Softmax and Sampling

Diversity-Promoting GAN: A Cross-Entropy Based Generative Adversarial Network for Diversified Text Generation

Closing the Curious Case of Neural Text Degeneration

DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text

Lingxi: A Diversity-aware Chinese Modern Poetry Generation System

Differentiated Distribution Recovery for Neural Text Generation

The Curious Case of Neural Text Degeneration

Improving Open-Ended Text Generation via Adaptive Decoding

Evade the Trap of Mediocrity: Promoting Diversity and Novelty in Text Generation Via Concentrating Attention

Balancing Diversity and Risk in LLM Sampling: How to Select Your Method and Parameter for Open-Ended Text Generation

Toward Diverse Text Generation with Inverse Reinforcement Learning

Controllable Text Generation for Open-Domain Creativity and Fairness

Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding

Informed Sampling for Diversity in Concept-to-Text NLG

Generating Diverse and High-Quality Texts by Minimum Bayes Risk Decoding

A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation

Exploring the Pareto-Optimality between Quality and Diversity in Text Generation