Abstract:We introduce meta-prompting, an effective scaffolding technique designed to enhance the functionality of language models (LMs). This approach transforms a single LM into a multi-faceted conductor, adept at managing and integrating multiple independent LM queries. By employing high-level instructions, meta-prompting guides the LM to break down complex tasks into smaller, more manageable subtasks. These subtasks are then handled by distinct "expert" instances of the same LM, each operating under specific, tailored instructions. Central to this process is the LM itself, in its role as the conductor, which ensures seamless communication and effective integration of the outputs from these expert models. It additionally employs its inherent critical thinking and robust verification processes to refine and authenticate the end result. This collaborative prompting approach empowers a single LM to simultaneously act as a comprehensive orchestrator and a panel of diverse experts, significantly enhancing its performance across a wide array of tasks. The zero-shot, task-agnostic nature of meta-prompting greatly simplifies user interaction by obviating the need for detailed, task-specific instructions. Furthermore, our research demonstrates the seamless integration of external tools, such as a Python interpreter, into the meta-prompting framework, thereby broadening its applicability and utility. Through rigorous experimentation with GPT-4, we establish the superiority of meta-prompting over conventional scaffolding methods: When averaged across all tasks, including the Game of 24, Checkmate-in-One, and Python Programming Puzzles, meta-prompting, augmented with a Python interpreter functionality, surpasses standard prompting by 17.1%, expert (dynamic) prompting by 17.3%, and multipersona prompting by 15.2%.

Meta Prompting for AGI Systems

Meta Prompting for AI Systems

Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffolding

On Meta-Prompting

MetaPrompting: Learning to Learn Better Prompts

Prompt Engineering a Prompt Engineer

Metacognitive Prompting Improves Understanding in Large Language Models

Effective Structured Prompting by Meta-Learning and Representative Verbalizer

PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization

Unlocking Structured Thinking in Language Models with Cognitive Prompting

Prompt Engineering or Fine Tuning: An Empirical Assessment of Large Language Models in Automated Software Engineering Tasks

Autonomous Prompt Engineering in Large Language Models

Towards Generalist Prompting for Large Language Models by Mental Models

The Prompt Report: A Systematic Survey of Prompting Techniques

Assessing the Impact of Prompting Methods on ChatGPT's Mathematical Capabilities

Prompt Space Optimizing Few-shot Reasoning Success with Large Language Models

AMPO: Automatic Multi-Branched Prompt Optimization

When Emotional Stimuli meet Prompt Designing: An Auto-Prompt Graphical Paradigm

Meta Reasoning for Large Language Models

PRompt Optimization in Multi-Step Tasks (PROMST): Integrating Human Feedback and Heuristic-based Sampling

Plum: Prompt Learning using Metaheuristic