Abstract:In Natural Language Processing (NLP), Large Language Models (LLMs) have demonstrated high text generation quality. However, in real-world applications, LLMs must meet increasingly complex requirements. Beyond avoiding misleading or inappropriate content, LLMs are also expected to cater to specific user needs, such as imitating particular writing styles or generating text with poetic richness. These varied demands have driven the development of Controllable Text Generation (CTG) techniques, which ensure that outputs adhere to predefined control conditions--such as safety, sentiment, thematic consistency, and linguistic style--while maintaining high standards of helpfulness, fluency, and diversity. This paper systematically reviews the latest advancements in CTG for LLMs, offering a comprehensive definition of its core concepts and clarifying the requirements for control conditions and text quality. We categorize CTG tasks into two primary types: content control and attribute control. The key methods are discussed, including model retraining, fine-tuning, reinforcement learning, prompt engineering, latent space manipulation, and decoding-time intervention. We analyze each method's characteristics, advantages, and limitations, providing nuanced insights for achieving generation control. Additionally, we review CTG evaluation methods, summarize its applications across domains, and address key challenges in current research, including reduced fluency and practicality. We also propose several appeals, such as placing greater emphasis on real-world applications in future research. This paper aims to offer valuable guidance to researchers and developers in the field. Our reference list and Chinese version are open-sourced at <a class="link-external link-https" href="https://github.com/IAAR-Shanghai/CTGSurvey" rel="external noopener nofollow">this https URL</a>.

Controlled Text Generation for Black-box Language Models via Score-based Progressive Editor

Critic-Guided Decoding for Controlled Text Generation

Controllable Text Generation for Open-Domain Creativity and Fairness

Language Generation with Strictly Proper Scoring Rules

Controllable Text Generation Using Semantic Control Grammar

INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic Feedback

Controlled Text Generation as Continuous Optimization with Multiple Constraints

Controllable Text Generation with Language Constraints

MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models

TypeScore: A Text Fidelity Metric for Text-to-Image Generative Models

Harnessing the Plug-and-Play Controller by Prompting

Select and Attend: Towards Controllable Content Selection in Text Generation

FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training

Controlled Text Generation using T5 based Encoder-Decoder Soft Prompt Tuning and Analysis of the Utility of Generated Text in AI

Controllable Generation from Pre-trained Language Models via Inverse Prompting

SAG: Style-Aligned Article Generation via Model Collaboration

Learning to Generate Text in Arbitrary Writing Styles

Controllable Text Generation for Large Language Models: A Survey

POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models