Abstract:In this tutorial, we focus on text-to-text generation, a class of natural language generation (NLG) tasks, that takes a piece of text as input and then generates a revision that is improved according to some specific criteria (e.g., readability or linguistic styles), while largely retaining the original meaning and the length of the text. This includes many useful applications, such as text simplification, paraphrase generation, style transfer, etc. In contrast to text summarization and open-ended text completion (e.g., story), the text-to-text generation tasks we discuss in this tutorial are more constrained in terms of semantic consistency and targeted language styles. This level of control makes these tasks ideal testbeds for studying the ability of models to generate text that is both semantically adequate and stylistically appropriate. Moreover, these tasks are interesting from a technical standpoint, as they require complex combinations of lexical and syntactical transformations, stylistic control, and adherence to factual knowledge, -- all at once. With a special focus on text simplification and revision, this tutorial aims to provide an overview of the state-of-the-art natural language generation research from four major aspects -- Data, Models, Human-AI Collaboration, and Evaluation -- and to discuss and showcase a few significant and recent advances: (1) the use of non-retrogressive approaches; (2) the shift from fine-tuning to prompting with large language models; (3) the development of new learnable metric and fine-grained human evaluation framework; (4) a growing body of studies and datasets on non-English languages; (5) the rise of HCI+NLP+Accessibility interdisciplinary research to create real-world writing assistant systems.

Post-edit Analysis of Collective Biography Generation

On How Users Edit Computer-Generated Visual Stories

Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation

BioGen: Automated Biography Generation

Automatic and Human-AI Interactive Text Generation

Text Generation with Text-Editing Models

Plan, Write, and Revise: an Interactive System for Open-Domain Story Generation

Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation

Et Machina: Exploring the Use of Conversational Agents Such as ChatGPT in Scientific Writing

Removing Manually-Generated Boilerplate from Electronic Texts: Experiments with Project Gutenberg e-Books

A Self-Supervised Automatic Post-Editing Data Generation Tool

EditEval: An Instruction-Based Benchmark for Text Improvements

An Information-Theoretic Approach for Detecting Edits in AI-Generated Text

Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries

Automated Postediting of Documents

Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges

ChatGPT vs Human-authored Text: Insights into Controllable Text Summarization and Sentence Style Transfer

PROTOTYPE-TO-STYLE: Dialogue Generation with Style-Aware Editing on Retrieval Memory

Generating Full Length Wikipedia Biographies: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographies

A pedagogical design for self-regulated learning in academic writing using text-based generative artificial intelligence tools: 6-P pedagogy of plan, prompt, preview, produce, peer-review, portfolio-tracking

An Exploration of Post-Editing Effectiveness in Text Summarization