Abstract:Large Language Models (LLMs) exhibit remarkable proficiency in addressing a diverse array of tasks within the Natural Language Processing (NLP) domain, with various prompt design strategies significantly augmenting their capabilities. However, these prompts, while beneficial, each possess inherent limitations. The primary prompt design methodologies are twofold: The first, exemplified by the Chain of Thought (CoT), involves manually crafting prompts specific to individual datasets, hence termed Expert-Designed Prompts (EDPs). Once these prompts are established, they are unalterable, and their effectiveness is capped by the expertise of the human designers. When applied to LLMs, the static nature of EDPs results in a uniform approach to both simple and complex problems within the same dataset, leading to the inefficient use of tokens for straightforward issues. The second method involves prompts autonomously generated by the LLM, known as LLM-Derived Prompts (LDPs), which provide tailored solutions to specific problems, mitigating the limitations of EDPs. However, LDPs may encounter a decline in performance when tackling complex problems due to the potential for error accumulation during the solution planning process. To address these challenges, we have conceived a novel Prompt Recursive Search (PRS) framework that leverages the LLM to generate solutions specific to the problem, thereby conserving tokens. The framework incorporates an assessment of problem complexity and an adjustable structure, ensuring a reduction in the likelihood of errors. We have substantiated the efficacy of PRS framework through extensive experiments using LLMs with different numbers of parameters across a spectrum of datasets in various domains. Compared to the CoT method, the PRS method has increased the accuracy on the BBH dataset by 8% using Llama3-7B model, achieving a 22% improvement.

Large Language Models Know Your Contextual Search Intent: A Prompting Framework for Conversational Search

Query Expansion by Prompting Large Language Models

Large Language Models are Contrastive Reasoners

Large Language Models are Good Multi-lingual Learners : When LLMs Meet Cross-lingual Prompts

Efficient Prompting Methods for Large Language Models: A Survey

CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search

Context-faithful Prompting for Large Language Models

Helping Language Models Learn More: Multi-dimensional Task Prompt for Few-shot Tuning

Prompting Large Language Models for Recommender Systems: A Comprehensive Framework and Empirical Analysis

Rewriting Conversational Utterances with Instructed Large Language Models

Large Language Models Might Not Care What You Are Saying: Prompt Format Beats Descriptions

Automatic Prompt Selection for Large Language Models

Fairness-guided Few-shot Prompting for Large Language Models

Prompt Recursive Search: A Living Framework with Adaptive Growth in LLM Auto-Prompting

Prompting Is Programming: A Query Language for Large Language Models

Self-Explanation Prompting Improves Dialogue Understanding in Large Language Models

Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting

Knowledge-Augmented Large Language Models for Personalized Contextual Query Suggestion

Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration

Large Language Model Prompt Chaining for Long Legal Document Classification

Making Large Language Models Interactive: A Pioneer Study on Supporting Complex Information-Seeking Tasks with Implicit Constraints