Abstract:Large Language Models (LLMs) exhibit remarkable proficiency in addressing a diverse array of tasks within the Natural Language Processing (NLP) domain, with various prompt design strategies significantly augmenting their capabilities. However, these prompts, while beneficial, each possess inherent limitations. The primary prompt design methodologies are twofold: The first, exemplified by the Chain of Thought (CoT), involves manually crafting prompts specific to individual datasets, hence termed Expert-Designed Prompts (EDPs). Once these prompts are established, they are unalterable, and their effectiveness is capped by the expertise of the human designers. When applied to LLMs, the static nature of EDPs results in a uniform approach to both simple and complex problems within the same dataset, leading to the inefficient use of tokens for straightforward issues. The second method involves prompts autonomously generated by the LLM, known as LLM-Derived Prompts (LDPs), which provide tailored solutions to specific problems, mitigating the limitations of EDPs. However, LDPs may encounter a decline in performance when tackling complex problems due to the potential for error accumulation during the solution planning process. To address these challenges, we have conceived a novel Prompt Recursive Search (PRS) framework that leverages the LLM to generate solutions specific to the problem, thereby conserving tokens. The framework incorporates an assessment of problem complexity and an adjustable structure, ensuring a reduction in the likelihood of errors. We have substantiated the efficacy of PRS framework through extensive experiments using LLMs with different numbers of parameters across a spectrum of datasets in various domains. Compared to the CoT method, the PRS method has increased the accuracy on the BBH dataset by 8% using Llama3-7B model, achieving a 22% improvement.

Enhance Performance of Ad-hoc Search via Prompt Learning.

AdaPrompt: Adaptive Model Training for Prompt-based NLP

Survival of the Most Influential Prompts: Efficient Black-Box Prompt Search via Clustering and Pruning

Prompt Recursive Search: A Living Framework with Adaptive Growth in LLM Auto-Prompting

Instance-wise Prompt Tuning for Pretrained Language Models

QPO: Query-dependent Prompt Optimization via Multi-Loop Offline Reinforcement Learning

Prompt Optimization in Large Language Models

A Bayesian approach for prompt optimization in pre-trained language models

Helping Language Models Learn More: Multi-dimensional Task Prompt for Few-shot Tuning

Exploring Lottery Prompts for Pre-trained Language Models

Adaptive Multi-Modality Prompt Learning

PRompt Optimization in Multi-Step Tasks (PROMST): Integrating Human Feedback and Heuristic-based Sampling

Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner

Prompting through Prototype: A Prototype-based Prompt Learning on Pretrained Vision-Language Models

PPT: Pre-trained Prompt Tuning for Few-shot Learning

MetaPrompting: Learning to Learn Better Prompts

TransPrompt V2: Transferable Prompt-based Fine-tuning for Few-shot Text Classification

Towards Unified Prompt Tuning for Few-shot Text Classification

Revisiting the Power of Prompt for Visual Tuning

Efficient Prompt Tuning by Multi-Space Projection and Prompt Fusion