A discriminator improves unconditional text generation without updating the generator

Xingyuan Chen, Ping Cai, Peng Jin, Hongjun Wang, Xinyu Dai, Jiajun Chen

2020-01-01

Abstract:

What problem does this paper attempt to address?

Adding A Filter Based on The Discriminator to Improve Unconditional Text Generation

Xingyuan Chen,Ping Cai,Peng Jin,Hongjun Wang,Xinyu Dai,Jiajun Chen

DOI: https://doi.org/10.48550/arxiv.2004.02135

2020-01-01

Abstract:The autoregressive language model (ALM) trained with maximum likelihood estimation (MLE) is widely used in unconditional text generation. Due to exposure bias, the generated texts still suffer from low quality and diversity. This presents statistically as a discrepancy between the real text and generated text. Some research shows a discriminator can detect this discrepancy. Because the discriminator can encode more information than the generator, discriminator has the potentiality to improve generator. To alleviate the exposure bias, generative adversarial networks (GAN) use the discriminator to update the generator's parameters directly, but they fail by being evaluated precisely. A critical reason for the failure is the difference between the discriminator input and the ALM input. We propose a novel mechanism by adding a filter which has the same input as the discriminator. First, discriminator detects the discrepancy signals and passes to filter directly (or by learning). Then, we use the filter to reject some generated samples with a sampling-based method. Thus, the original generative distribution is revised to reduce the discrepancy. Two ALMs, RNN-based and Transformer-based, are experimented. Evaluated precisely by three metrics, our mechanism consistently outperforms the ALMs and all kinds of GANs across two benchmark data sets.
Adversarial Subsequences for Unconditional Text Generation

Xingyuan Chen,Peng Jin,Yanzhe Li,Jiuhua Zhang,Xinyu Dai,Jiajun Chen

DOI: https://doi.org/10.1016/j.csl.2021.101242

2021-01-01

Abstract:Generative Adversarial Nets (GAN) has been successfully introduced to unconditional generating text to alleviate exposure bias. However, the discriminator in this model only evaluates the entire sequence, which causes feedback sparsity and mode collapse. To tackle these problems, we propose a novel mechanism. The mechanism first segments the entire sequence into several subsequences. Then, these subsequences, together with the entire sequence, are evaluated individually by the discriminator. Finally, these feedback signals are all used to guide the learning of GAN. This mechanism learns the generation of both the entire sequence and the subsequences simultaneously. Learning to generate subsequences is easy and is helpful in generating an entire sequence. It is easy to improve the existing GAN-based models with this mechanism. Although Li et al. (2017) segments the generated responses in a conditional text generation task, i.e., a dialogue system, they conclude it is weaker than the Monte Carlo search. However, for unconditional text generation, we observe that adversarial learning on subsequences works well. We rebuild three previous models with our mechanism, and the experimental results on two benchmark datasets show these models are improved greatly and outperform the state-of-the-art model. (c) 2021 Elsevier Ltd. All rights reserved.
A Universal Discriminator for Zero-Shot Generalization

Haike Xu,Zongyu Lin,Jing Zhou,Yanan Zheng,Zhilin Yang

DOI: https://doi.org/10.48550/arxiv.2211.08099

2023-01-01

Abstract:Generative modeling has been the dominant approach for large-scale pretraining and zero-shot generalization. In this work, we challenge this convention by showing that discriminative approaches perform substantially better than generative ones on a large number of NLP tasks. Technically, we train a single discriminator to predict whether a text sample comes from the true data distribution, similar to GANs. Since many NLP tasks can be formulated as selecting from a few options, we use this discriminator to predict the concatenation of input and which option has the highest probability of coming from the true data distribution. This simple formulation achieves state-of-the-art zero-shot results on the T0 benchmark, outperforming T0 by 16.0%, 7.8%, and 11.5% respectively on different scales. In the finetuning setting, our approach also achieves new state-of-the-art results on a wide range of NLP tasks, with only 1/4 parameters of previous methods. Meanwhile, our approach requires minimal prompting efforts, which largely improves robustness and is essential for real-world applications. Furthermore, we also jointly train a generalized UD in combination with generative tasks, which maintains its advantage on discriminative tasks and simultaneously works on generative tasks.
Enhancing Text Generation with Cooperative Training

Tong Wu,Hao Wang,Zhongshen Zeng,Wei Wang,Hai-Tao Zheng,Jiaxing Zhang

DOI: https://doi.org/10.3233/faia230579

2023-01-01

Abstract:Recently, there has been a surge in the use of generated data to enhance the performance of downstream models, largely due to the advancements in pre-trained language models. However, most prevailing methods trained generative and discriminative models in isolation, which left them unable to adapt to changes in each other. These approaches lead to generative models that are prone to deviating from the true data distribution and providing limited benefits to discriminative models. While some works have proposed jointly training generative and discriminative language models, their methods remain challenging due to the non-differentiable nature of discrete data. To overcome these issues, we introduce a self-consistent learning framework in the text field that involves training a discriminator and generator cooperatively in a closed-loop manner until a scoring consensus is reached. By learning directly from selected samples, our framework are able to mitigate training instabilities such as mode collapse and non-convergence. Extensive experiments on four downstream benchmarks, including AFQMC, CHIP-STS, QQP, and MRPC, demonstrate the efficacy of the proposed framework.
Diversity-Promoting GAN: A Cross-Entropy Based Generative Adversarial Network for Diversified Text Generation

Jingjing Xu,Xuancheng Ren,Junyang Lin,Xu Sun

DOI: https://doi.org/10.18653/v1/d18-1428

2018-01-01

Abstract:Existing text generation methods tend to produce repeated and "boring" expressions. To tackle this problem, we propose a new text generation model, called Diversity-Promoting Generative Adversarial Network (DP-GAN). The proposed model assigns low reward for repeatedly generated text and high reward for "novel" and fluent text, encouraging the generator to produce diverse and informative text. Moreover, we propose a novel languagemodel based discriminator, which can better distinguish novel text from repeated text without the saturation problem compared with existing classifier-based discriminators. The experimental results on review generation and dialogue generation tasks demonstrate that our model can generate substantially more diverse and informative text than existing baselines.(1)
Adversarial Text Generation Via Sequence Contrast Discrimination.

Ke Wang,Xiaojun Wan

DOI: https://doi.org/10.18653/v1/2020.findings-emnlp.5

2020-01-01

Abstract:In this paper, we propose a sequence contrast loss driven text generation framework, which learns the difference between real texts and generated texts and uses that difference. Specifically, our discriminator contains a discriminative sequence generator instead of a binary classifier, and measures the ' relative realism ' of generated texts against real texts by making use of them simultaneously. Moreover, our generator uses discriminative sequences to directly improve itself, which not only replaces the gradient propagation process from the discriminator to the generator, but also avoids the time-consuming sampling process of estimating rewards in some previous methods. We conduct extensive experiments with various metrics, substantiating that our framework brings improvements in terms of training stability and the quality of generated texts.
Improving GANs with A Dynamic Discriminator

Ceyuan Yang,Yujun Shen,Yinghao Xu,Deli Zhao,Bo Dai,Bolei Zhou

DOI: https://doi.org/10.48550/arXiv.2209.09897

2022-09-21

Abstract:Discriminator plays a vital role in training generative adversarial networks (GANs) via distinguishing real and synthesized samples. While the real data distribution remains the same, the synthesis distribution keeps varying because of the evolving generator, and thus effects a corresponding change to the bi-classification task for the discriminator. We argue that a discriminator with an on-the-fly adjustment on its capacity can better accommodate such a time-varying task. A comprehensive empirical study confirms that the proposed training strategy, termed as DynamicD, improves the synthesis performance without incurring any additional computation cost or training objectives. Two capacity adjusting schemes are developed for training GANs under different data regimes: i) given a sufficient amount of training data, the discriminator benefits from a progressively increased learning capacity, and ii) when the training data is limited, gradually decreasing the layer width mitigates the over-fitting issue of the discriminator. Experiments on both 2D and 3D-aware image synthesis tasks conducted on a range of datasets substantiate the generalizability of our DynamicD as well as its substantial improvement over the baselines. Furthermore, DynamicD is synergistic to other discriminator-improving approaches (including data augmentation, regularizers, and pre-training), and brings continuous performance gain when combined for learning GANs.

Computer Vision and Pattern Recognition,Image and Video Processing
Improving Diversity of Neural Text Generation Via Inverse Probability Weighting

Xinran Zhang,Maosong Sun,Jiafeng Liu,Xiaobing Li

2021-01-01

Abstract:The neural text generation suffers from the text degeneration issue such as repetition. Traditional stochastic sampling methods only focus on truncating the unreliable "tail" of the distribution, and do not address the "head" part, which we show might contain tedious or even repetitive candidates with high probability that lead to repetition loops. They also do not consider the issue that human text does not always favor high-probability words. Inspired by these, in this work we propose a heuristic sampling method. We propose to use interquartile range of the predicted distribution to determine the "head" part, then permutate and rescale the "head" with inverse probability. This aims at decreasing the probability for the tedious and possibly repetitive candidates with higher probability, and increasing the probability for the rational but more surprising candidates with lower probability. The proposed algorithm provides a reasonable permutation on the predicted distribution which enhances diversity without compromising rationality of the distribution. We use pre-trained language model to compare our algorithm with traditional methods. Results show that our algorithm can effectively increase the diversity of generated samples while achieving close resemblance to human text.
Sequence Generative Adversarial Nets with a Conditional Discriminator

Yongfei Yan,Gehui Shen,Song Zhang,Ting Huang,Zhi-Hong Deng,Unil Yun

DOI: https://doi.org/10.1016/j.neucom.2020.10.108

IF: 6

2020-01-01

Neurocomputing

Abstract:The success of Generative Adversarial Networks (GANs) in image generation attracts researchers to design sequence GANs in text generation. However, the discriminators of those sequence GANs usually provide only one signal per sequence, which can not reflect detailed information, e.g. whether a token is appropriate in a sequence. In addition, maximum likelihood pre-training is typically used in those models, which is time-consuming and obscures the effects of adversarial training. To cope with these problems, we propose a new sequence GAN that consists of a conditional discriminator and a discriminator-augmented generator. The conditional discriminator provides a sequence with token-level signals. The generator is designed to approximate a discriminator-augmented distribution, which avoids pre-training. Experiments show that the conditional discriminator provides more informative guidance, and our model outperforms existing models according to metrics involving both sampling quality and sampling diversity.
CTG:A Controllable Text Generation Method based on the Joint Work of Language Model and Text Classifier

Xuyuan Liang,Lihua Tian,Chen Li,Zhang Mandi

DOI: https://doi.org/10.1109/cisce52179.2021.9445873

2021-01-01

Abstract:Text generation is an important research field in natural language processing. Today pre-trained models can generate text with high readability and fluency. However, the generated text content is usually not restricted, and the generated content cannot be controlled. Therefore, there is an urgent need for a controllable text generation method. Traditional controllable text generation methods usually have the disadvantages of high training cost and difficulty in adjustment. We propose a lightweight and easy-to-adjust method to update the language model through the discrimination results of the text classification model on the language model, thereby completing controllable text generation. And we have solved the problem of imbalance and quality degradation in text generation. Experiments show that the quality of the text generated by this method can also reach a higher level with strong subjectivity, can achieves the purpose of controlling text generation. And this method is easy to adjust, suitable for various scenarios.
DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text

Jingjing Xu,Xuancheng Ren,Junyang Lin,Xu Sun

DOI: https://doi.org/10.48550/arxiv.1802.01345

2018-01-01

Abstract:Existing text generation methods tend to produce repeated and "boring" expressions. To tackle this problem, we propose a new text generation model, called Diversity-Promoting Generative Adversarial Network (DP-GAN). The proposed model assigns low reward for repeatedly generated text and high reward for "novel" and fluent text, encouraging the generator to produce diverse and informative text. Moreover, we propose a novel language-model based discriminator, which can better distinguish novel text from repeated text without the saturation problem compared with existing classifier-based discriminators. The experimental results on review generation and dialogue generation tasks demonstrate that our model can generate substantially more diverse and informative text than existing baselines. The code is available at https://github.com/lancopku/DPGAN
A novel hybrid augmented loss discriminator for text-to-image synthesis

Yan Gan,Mao Ye,Dan Liu,Shangming Yang,Tao Xiang

DOI: https://doi.org/10.1002/int.22333

IF: 8.993

2021-01-01

International Journal of Intelligent Systems

Abstract:For the text-to-image synthesis task, most discriminators in existing generative adversarial networks based methods tend to fall into a local suboptimal state too early in the training process, resulting in the poor quality of generated images. To address the above problems, a hybrid augmented loss discriminator is designed. In this designed discriminator, to reduce the sensitivity of the discriminator classification recognition, make it pay attention to the semantic and structural changes, we add the loss value of the fake sample to the loss value of the real sample. Moreover, to indirectly guide the generator to generate samples, the loss value of the real sample is added to the fake sample. The loss value mixed with real and fake samples actually augments signal transmission. It perturbs parameter update of the discriminator during optimization and prevents the discriminator from falling into the local suboptimal state prematurely. Whereafter, we apply the proposed discriminator to two kinds of text-to-image synthesis tasks. Experimental results show that the proposed method can help the baseline models to improve performance.
Self-Adversarial Learning with Comparative Discrimination for Text Generation

Wangchunshu Zhou,Tao Ge,Ke Xu,Furu Wei,Ming Zhou

DOI: https://doi.org/10.48550/arXiv.2001.11691

2020-01-31

Computation and Language

Abstract:Conventional Generative Adversarial Networks (GANs) for text generation tend to have issues of reward sparsity and mode collapse that affect the quality and diversity of generated samples. To address the issues, we propose a novel self-adversarial learning (SAL) paradigm for improving GANs' performance in text generation. In contrast to standard GANs that use a binary classifier as its discriminator to predict whether a sample is real or generated, SAL employs a comparative discriminator which is a pairwise classifier for comparing the text quality between a pair of samples. During training, SAL rewards the generator when its currently generated sentence is found to be better than its previously generated samples. This self-improvement reward mechanism allows the model to receive credits more easily and avoid collapsing towards the limited number of real samples, which not only helps alleviate the reward sparsity issue but also reduces the risk of mode collapse. Experiments on text generation benchmark datasets show that our proposed approach substantially improves both the quality and the diversity, and yields more stable performance compared to the previous GANs for text generation.
Adversarial Sub-sequence for Text Generation.

Xingyuan Chen,Yanzhe Li,Peng Jin,Jiuhua Zhang,Xinyu Dai,Jiajun Chen,Gang Song

2019-01-01

Abstract: Generative adversarial nets (GAN) has been successfully introduced for generating text to alleviate the exposure bias. However, discriminators in these models only evaluate the entire sequence, which causes feedback sparsity and mode collapse. To tackle these problems, we propose a novel mechanism. It first segments the entire sequence into several sub-sequences. Then these sub-sequences, together with the entire sequence, are evaluated individually by the discriminator. At last these feedback signals are all used to guide the learning of GAN. This mechanism learns the generation of both the entire sequence and the sub-sequences simultaneously. Learning to generate sub-sequences is easy and is helpful in generating an entire sequence. It is easy to improve the existing GAN-based models with this mechanism. We rebuild three previous well-designed models with our mechanism, and the experimental results on benchmark data show these models are improved significantly, the best one outperforms the state-of-the-art model.\footnote[1]{All code and data are available at https://github.com/liyzcj/seggan.git
Which Discriminator for Cooperative Text Generation?

Antoine Chaffin,Thomas Scialom,Sylvain Lamprier,Jacopo Staiano,Benjamin Piwowarski,Ewa Kijak,Vincent Claveau

DOI: https://doi.org/10.1145/3477495.3531858

2022-04-25

Abstract:Language models generate texts by successively predicting probability distributions for next tokens given past ones. A growing field of interest tries to leverage external information in the decoding process so that the generated texts have desired properties, such as being more natural, non toxic, faithful, or having a specific writing style. A solution is to use a classifier at each generation step, resulting in a cooperative environment where the classifier guides the decoding of the language model distribution towards relevant texts for the task at hand. In this paper, we examine three families of (transformer-based) discriminators for this specific task of cooperative decoding: bidirectional, left-to-right and generative ones. We evaluate the pros and cons of these different types of discriminators for cooperative generation, exploring respective accuracy on classification tasks along with their impact on the resulting sample quality and computational performances. We also provide the code of a batched implementation of the powerful cooperative decoding strategy used for our experiments, the Monte Carlo Tree Search, working with each discriminator for Natural Language Generation.

Computation and Language
CDGAN-BERT: Adversarial constraint and diversity discriminator for semi-supervised text classification

Nai Zhou,Nianmin Yao,Nannan Hu,Jian Zhao,Yanan Zhang

DOI: https://doi.org/10.1016/j.knosys.2023.111291

IF: 8.139

2023-12-12

Knowledge-Based Systems

Abstract:Semi-supervised generative adversarial learning (SS-GAN) significantly improves the model's performance with limited labeled data , especially on text classification. However, these SS-GAN-like works pay more attention to the more real properties of the generated samples and ignore their adversarial nature, which may prevent the model from learning more higher-quality data representations. And the existing single discriminator may produce discrimination ambiguity when discriminating against tasks with different discriminative properties (simultaneously identifying real or fake and classifying categories), which may harm the model's classification performance. In this paper, we propose a novel CDGAN-BERT, an SS-GAN-based architecture with the adversarial constraint and a diversity discriminator. Specifically, CDGAN-BERT first focuses on adversarial constraint, which calculates the model's intrinsic state representation with the reciprocal of Mean Squared Error (MSE), further keeping adversarial of the generated samples relative to the real data distribution. Then, a diversity discriminator is designed to improve the model's classification performance by alleviating discriminative ambiguity, which refines tasks with different discriminative attributes by adding an additional authenticity discriminator. We validate our model on 6 text datasets and achieve significant improvements, especially with limited supervision. The experimental results show that our method outperforms or gets comparable results to other state-of-the-art semi-supervised learning methods on several datasets. Especially for the datasets of QC-Fine and QC-Coarse with limited labeled data, our CDGAN-BERT achieves the best average Micro-F1 scores of 72.5% and 92.037%, respectively.

computer science, artificial intelligence
Text to Image Synthesis Based on Multiple Discrimination

Zhiqiang Zhang,Yunye Zhang,Wenxin Yu,Jingwei Lu,Li Nie,Gang He,Ning Jiang,Gang He,Yibo Fan,Zhuo Yang

DOI: https://doi.org/10.1007/978-3-030-30508-6_46

2019-01-01

Abstract:We propose a novel and simple text-to-image synthesizer (MD-GAN) using multiple discrimination. Based on the Generative Adversarial Network (GAN), we introduce segmentation images to the discriminator to ensure the improvement of discrimination ability. The improvement of discrimination ability will enhance the generator’s generating ability, thus obtaining high-resolution results. Experiments well validate the outstanding performance of our algorithm. On CUB dataset, our inception score is 27.7% and 1.7% higher than GAN-CLS-INT and GAWWN, respectively. On the flower dataset, it further outplays GAN-CLS-INT and StackGAN by 21.8% and 1.25%, respectively. At the same time, our model is more concise in structure, and its training time is only half that of StackGAN.
Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap Between Training and Inference!

Zecheng Tang,Pinzheng Wang,Keyan Zhou,Juntao Li,Zhigang Cao,Min Zhang

DOI: https://doi.org/10.48550/arxiv.2305.04465

2023-01-01

Abstract:Diffusion models have been successfully adapted to text generation tasks by mapping the discrete text into the continuous space. However, there exist nonnegligible gaps between training and inference, owing to the absence of the forward process during inference. Thus, the model only predicts based on the previously generated reverse noise rather than the noise computed by the forward process. Besides, the widely-used downsampling strategy in speeding up the inference will cause the mismatch of diffusion trajectories between training and inference. To understand and mitigate the above two types of training-inference discrepancies, we launch a thorough preliminary study. Based on our observations, we propose two simple yet effective methods to bridge the gaps mentioned above, named Distance Penalty and Adaptive Decay Sampling. Extensive experiments on \textbf{6} generation tasks confirm the superiority of our methods, which can achieve $100\times \rightarrow 200\times$ speedup with better performance.
Improving GAN Training with Probability Ratio Clipping and Sample Reweighting

Yue Wu,Pan Zhou,Andrew Gordon Wilson,Eric P. Xing,Zhiting Hu

DOI: https://doi.org/10.48550/arXiv.2006.06900

IF: 5.414

2020-06-12

Machine Learning

Abstract:Despite success on a wide range of problems related to vision, generative adversarial networks (GANs) often suffer from inferior performance due to unstable training, especially for text generation. To solve this issue, we propose a new variational GAN training framework which enjoys superior training stability. Our approach is inspired by a connection of GANs and reinforcement learning under a variational perspective. The connection leads to (1) probability ratio clipping that regularizes generator training to prevent excessively large updates, and (2) a sample re-weighting mechanism that improves discriminator training by downplaying bad-quality fake samples. Moreover, our variational GAN framework can provably overcome the training issue in many GANs that an optimal discriminator cannot provide any informative gradient to training generator. By plugging the training approach in diverse state-of-the-art GAN architectures, we obtain significantly improved performance over a range of tasks, including text generation, text style transfer, and image generation.
Discriminative Probing and Tuning for Text-to-Image Generation

Leigang Qu,Wenjie Wang,Yongqi Li,Hanwang Zhang,Liqiang Nie,Tat-Seng Chua

2024-03-14

Abstract:Despite advancements in text-to-image generation (T2I), prior methods often face text-image misalignment problems such as relation confusion in generated images. Existing solutions involve cross-attention manipulation for better compositional understanding or integrating large language models for improved layout planning. However, the inherent alignment capabilities of T2I models are still inadequate. By reviewing the link between generative and discriminative modeling, we posit that T2I models' discriminative abilities may reflect their text-image alignment proficiency during generation. In this light, we advocate bolstering the discriminative abilities of T2I models to achieve more precise text-to-image alignment for generation. We present a discriminative adapter built on T2I models to probe their discriminative abilities on two representative tasks and leverage discriminative fine-tuning to improve their text-image alignment. As a bonus of the discriminative adapter, a self-correction mechanism can leverage discriminative gradients to better align generated images to text prompts during inference. Comprehensive evaluations across three benchmark datasets, including both in-distribution and out-of-distribution scenarios, demonstrate our method's superior generation performance. Meanwhile, it achieves state-of-the-art discriminative performance on the two discriminative tasks compared to other generative models.

Computer Vision and Pattern Recognition,Artificial Intelligence,Computation and Language,Multimedia

A discriminator improves unconditional text generation without updating the generator

Adding A Filter Based on The Discriminator to Improve Unconditional Text Generation

Adversarial Subsequences for Unconditional Text Generation

A Universal Discriminator for Zero-Shot Generalization

Enhancing Text Generation with Cooperative Training

Diversity-Promoting GAN: A Cross-Entropy Based Generative Adversarial Network for Diversified Text Generation

Adversarial Text Generation Via Sequence Contrast Discrimination.

Improving GANs with A Dynamic Discriminator

Improving Diversity of Neural Text Generation Via Inverse Probability Weighting

Sequence Generative Adversarial Nets with a Conditional Discriminator

CTG:A Controllable Text Generation Method based on the Joint Work of Language Model and Text Classifier

DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text

A novel hybrid augmented loss discriminator for text-to-image synthesis

Self-Adversarial Learning with Comparative Discrimination for Text Generation

Adversarial Sub-sequence for Text Generation.

Which Discriminator for Cooperative Text Generation?

CDGAN-BERT: Adversarial constraint and diversity discriminator for semi-supervised text classification

Text to Image Synthesis Based on Multiple Discrimination

Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap Between Training and Inference!

Improving GAN Training with Probability Ratio Clipping and Sample Reweighting

Discriminative Probing and Tuning for Text-to-Image Generation