Abstract:Automatic text generation has garnered growing attention in recent years as an essential step towards computer creativity. Generative Pretraining Transformer 2 (GPT2) is one of the state of the art approaches that have excellent successes. In this paper, we took the first step to investigate the power of GPT2 in traditional Vietnamese poetry generation. In the earlier time, our experiment with base GPT2 was quite good at generating the poem in the proper template. Though it can learn the patterns, including rhyme and tone rules, from the training data, like almost all other text generation approaches, the poems generated still has a topic drift and semantic inconsistency. To improve the cohesion within the poems, we proposed a new model SP-GPT2 (semantic poem GPT2) which was built on the top GPT2 model and an additional loss to constrain context throughout the entire poem. For better evaluation, we examined the methods by both automatic quantitative evaluation and human evaluation. Both automatic and human evaluation demonstrated that our approach can generate poems that have better cohesion without losing the quality due to additional loss. At the same time, we are the pioneers of this topic. We released the first computational scoring module for poems generated in the template containing the style rule dictionary. Additionally, we are the first to publish a Luc-Bat dataset, including 87609 Luc Bat poems, which is equivalent to about 2.6 million sentences, combined with about 83579 poems in other styles was also published for further exploration. The code is available at <a class="link-external link-https" href="https://github.com/fsoft-ailab/Poem-Generator" rel="external noopener nofollow">this https URL</a>

GPT Czech Poet: Generation of Czech Poetic Strophes with Language Models

Poetry Generation Algorithm with Automatic Expansion of Keyword Semantic Information

ByGPT5: End-to-End Style-conditioned Poetry Generation with Token-free Language Models

GPT-based Generation for Classical Chinese Poetry

GPoeT-2: A GPT-2 Based Poem Generator

Introducing Aspects of Creativity in Automatic Poetry Generation

Vietnamese Poem Generation & The Prospect Of Cross-Language Poem-To-Poem Translation

Deep learning and sub-word-unit approach in written art generation

Automatic Poetic Metre Detection for Czech Verse

Generating Major Types of Chinese Classical Poetry in a Uniformed Framework

SP-GPT2: Semantics Improvement in Vietnamese Poetry Generation

Generate and Revise: Reinforcement Learning in Neural Poetry

Modern French Poetry Generation with RoBERTa and GPT-2

LLM-based multi-agent poetry generation in non-cooperative environments

Neural Poetry: Learning to Generate Poems using Syllables

Automatic Generation and Evaluation of French-Style Chinese Modern Poetry

Arabic Poems Generation using LSTM, Markov-LSTM and Pre-Trained GPT-2 Models

Creative GANs for generating poems, lyrics, and metaphors

Bits of Grass: Does GPT already know how to write like Whitman?

Let's FACE it. Finnish Poetry Generation with Aesthetics and Framing

Generation of Chinese classical poetry based on pre-trained model