Abstract:Large language models (LLMs) have shown success in generating high-quality responses. In order to achieve better alignment with LLMs with human preference, various works are proposed based on specific optimization process, which, however, is not suitable to Black-Box LLMs like GPT-4, due to inaccessible parameters. In Black-Box LLMs case, their performance is highly dependent on the quality of the provided prompts. Existing methods to enhance response quality often involve a prompt refinement model, yet these approaches potentially suffer from semantic inconsistencies between the refined and original prompts, and typically overlook the relationship between them. To address these challenges, we introduce a self-instructed in-context learning framework that empowers LLMs to deliver more effective responses by generating reliable derived prompts to construct informative contextual environments. Our approach incorporates a self-instructed reinforcement learning mechanism, enabling direct interaction with the response model during derived prompt generation for better alignment. We then formulate querying as an in-context learning task, using responses from LLMs combined with the derived prompts to establish a contextual demonstration for the original prompt. This strategy ensures alignment with the original query, reduces discrepancies from refined prompts, and maximizes the LLMs' in-context learning capability. Extensive experiments demonstrate that the proposed method not only generates more reliable derived prompts but also significantly enhances LLMs' ability to deliver more effective responses, including Black-Box models such as GPT-4.

$k$NN Prompting: Learning Beyond the Context with Nearest Neighbor Inference

$k$NN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inference

Faster Nearest Neighbor Machine Translation

kNN-Prompt: Nearest Neighbor Zero-Shot Inference

kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest Neighbor In-Context Learning

Nearest Neighbor Speculative Decoding for LLM Generation and Attribution

Revisiting K-Nn for Fine-Tuning Pre-trained Language Models

Structured Prompting: Scaling In-Context Learning to 1,000 Examples

GNNavi: Navigating the Information Flow in Large Language Models by Graph Neural Network

Batch Prompting: Efficient Inference with Large Language Model APIs

Graph Neural Prompting with Large Language Models

Great Memory, Shallow Reasoning: Limits of $k$NN-LMs

Learning To Retrieve Prompts for In-Context Learning

Context-faithful Prompting for Large Language Models

Let's Ask GNN: Empowering Large Language Model for Graph In-Context Learning

Learning to Compress Prompt in Natural Language Formats

Skill-Based Few-Shot Selection for In-Context Learning

Self-Instructed Derived Prompt Generation Meets In-Context Learning: Unlocking New Potential of Black-Box LLMs

SeCoKD: Aligning Large Language Models for In-Context Learning with Fewer Shots

Rethinking Time Series Forecasting with LLMs via Nearest Neighbor Contrastive Learning

$k$NN-NER: Named Entity Recognition with Nearest Neighbor Search