A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications

Pranab Sahoo, Ayush Kumar Singh, Sriparna Saha, Vinija Jain, Samrat Mondal, Aman Chadha

2024-02-06

Abstract:Prompt engineering has emerged as an indispensable technique for extending the capabilities of large language models (LLMs) and vision-language models (VLMs). This approach leverages task-specific instructions, known as prompts, to enhance model efficacy without modifying the core model parameters. Rather than updating the model parameters, prompts allow seamless integration of pre-trained models into downstream tasks by eliciting desired model behaviors solely based on the given prompt. Prompts can be natural language instructions that provide context to guide the model or learned vector representations that activate relevant knowledge. This burgeoning field has enabled success across various applications, from question-answering to commonsense reasoning. However, there remains a lack of systematic organization and understanding of the diverse prompt engineering methods and techniques. This survey paper addresses the gap by providing a structured overview of recent advancements in prompt engineering, categorized by application area. For each prompting approach, we provide a summary detailing the prompting methodology, its applications, the models involved, and the datasets utilized. We also delve into the strengths and limitations of each approach and include a taxonomy diagram and table summarizing datasets, models, and critical points of each prompting technique. This systematic analysis enables a better understanding of this rapidly developing field and facilitates future research by illuminating open challenges and opportunities for prompt engineering.

Artificial Intelligence,Computation and Language,Human-Computer Interaction

What problem does this paper attempt to address?

The paper aims to address the adaptability and flexibility issues of large language models (LLMs) and vision-language models (VLMs) in different tasks. Specifically, the paper focuses on how to enhance the capabilities of these pre-trained models through "Prompt Engineering" techniques, enabling them to be guided by carefully designed task-specific instructions (i.e., prompts) without modifying core parameters. The paper points out the lack of systematic organization and understanding of various prompt engineering techniques in the existing literature and attempts to fill this gap by providing a structured overview.

The paper covers a variety of prompt engineering techniques, from Zero-Shot and Few-Shot prompts to more complex methods like Chain-of-Thought (CoT) prompts. The authors provide a detailed summary of each technique, including its methodology, application scope, the models used, and experimental datasets, and discuss the advantages and limitations of each technique. Additionally, the paper offers a classification diagram and tables summarizing the key points of various prompt techniques, enabling researchers and practitioners to better understand and apply these techniques.

In summary, the main goal of the paper is to provide a comprehensive resource for researchers and practitioners in the field of prompt engineering, to facilitate understanding of the latest advancements in the field, and to lay the foundation for future research.