Abstract:In Natural Language Processing (NLP), Large Language Models (LLMs) have demonstrated high text generation quality. However, in real-world applications, LLMs must meet increasingly complex requirements. Beyond avoiding misleading or inappropriate content, LLMs are also expected to cater to specific user needs, such as imitating particular writing styles or generating text with poetic richness. These varied demands have driven the development of Controllable Text Generation (CTG) techniques, which ensure that outputs adhere to predefined control conditions--such as safety, sentiment, thematic consistency, and linguistic style--while maintaining high standards of helpfulness, fluency, and diversity. This paper systematically reviews the latest advancements in CTG for LLMs, offering a comprehensive definition of its core concepts and clarifying the requirements for control conditions and text quality. We categorize CTG tasks into two primary types: content control and attribute control. The key methods are discussed, including model retraining, fine-tuning, reinforcement learning, prompt engineering, latent space manipulation, and decoding-time intervention. We analyze each method's characteristics, advantages, and limitations, providing nuanced insights for achieving generation control. Additionally, we review CTG evaluation methods, summarize its applications across domains, and address key challenges in current research, including reduced fluency and practicality. We also propose several appeals, such as placing greater emphasis on real-world applications in future research. This paper aims to offer valuable guidance to researchers and developers in the field. Our reference list and Chinese version are open-sourced at <a class="link-external link-https" href="https://github.com/IAAR-Shanghai/CTGSurvey" rel="external noopener nofollow">this https URL</a>.

Classifiers are Better Experts for Controllable Text Generation

CTG:A Controllable Text Generation Method based on the Joint Work of Language Model and Text Classifier

Controllable Text Generation Via Probability Density Estimation in the Latent Space

Flexible text generation for counterfactual fairness probing

Towards Agile Text Classifiers for Everyone

DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts

Teaching Others is Teaching Yourself Regularization For Controllable Language Models

Controllable Text Generation with Language Constraints

FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training

FreeCtrl: Constructing Control Centers with Feedforward Layers for Learning-Free Controllable Text Generation

Controlled Text Generation for Large Language Model with Dynamic Attribute Graphs

An Invariant Learning Characterization of Controlled Text Generation

Improving Controllable Text Generation with Position-Aware Weighted Decoding

Stay on topic with Classifier-Free Guidance

Explaining Text Classifiers with Counterfactual Representations

A Comparative Analysis of Counterfactual Explanation Methods for Text Classifiers

Rule-based adversarial sample generation for text classification

Controllable Text Generation for Large Language Models: A Survey

Transparent Neighborhood Approximation for Text Classifier Explanation

How to Generate Reasonable Texts with Controlled Attributes

Toward Controlled Generation of Text