Abstract:We introduce Directional Stimulus Prompting, a novel framework for guiding black-box large language models (LLMs) toward specific desired outputs. Instead of directly adjusting LLMs, our method employs a small tunable policy model (e.g., T5) to generate an auxiliary directional stimulus prompt for each input instance. These directional stimulus prompts act as nuanced, instance-specific hints and clues to guide LLMs in generating desired outcomes, such as including specific keywords in the generated summary. Our approach sidesteps the challenges of direct LLM tuning by optimizing the policy model to explore directional stimulus prompts that align LLMs with desired behaviors. The policy model can be optimized through 1) supervised fine-tuning using labeled data and 2) reinforcement learning from offline or online rewards based on the LLM's output. We assess our method across summarization, dialogue response generation, and chain-of-thought reasoning tasks. Our experiments demonstrate that the framework consistently improves LLMs' (e.g., ChatGPT, Codex, InstructGPT) performance on these supervised tasks using minimal labeled data. Notably, using just 80 dialogues on the MultiWOZ dataset, our approach enhances ChatGPT's performance by an impressive 41.4%, matching or surpassing some fully supervised start-of-the-art models. Additionally, the instance-specific chain-of-thought prompt generated by our approach improves InstructGPT's reasoning accuracy compared to human-crafted or automatically generated prompts. The code and data are publicly available at \url{<a class="link-external link-https" href="https://github.com/Leezekun/Directional-Stimulus-Prompting" rel="external noopener nofollow">this https URL</a>}.

Enabling Controllable Table-to-text Generation Via Prompting Large Language Models with Guided Planning

Guiding Large Language Models via Directional Stimulus Prompting

Few-Shot Table-to-Text Generation with Prompt Planning and Knowledge Memorization

Prompt-Based Length Controlled Generation with Reinforcement Learning

Adapting Prompt for Few-shot Table-to-Text Generation

ProgPrompt: Generating Situated Robot Task Plans using Large Language Models

Helping Language Models Learn More: Multi-dimensional Task Prompt for Few-shot Tuning

Deliberate then generate: Enhanced prompting framework for text generation

Controllable Generation from Pre-trained Language Models via Inverse Prompting

RePrompt: Planning by Automatic Prompt Engineering for Large Language Models Agents

ProgPrompt: program generation for situated robot task planning using large language models

A Better LLM Evaluator for Text Generation: The Impact of Prompt Output Sequencing and Optimization

Control Large Language Models via Divide and Conquer

Unlocking Anticipatory Text Generation: A Constrained Approach for Large Language Models Decoding

Prompt Highlighter: Interactive Control for Multi-Modal LLMs

Supervisory Prompt Training

Prompt-Based Length Controlled Generation with Multiple Control Types

Large Language Models are Good Multi-lingual Learners : When LLMs Meet Cross-lingual Prompts

XPrompt:Explaining Large Language Model's Generation via Joint Prompt Attribution

Automatic Prompt Selection for Large Language Models