Abstract:Large language models (LLMs) have shown remarkable performance on many different Natural Language Processing (NLP) tasks. Prompt engineering plays a key role in adding more to the already existing abilities of LLMs to achieve significant performance gains on various NLP tasks. Prompt engineering requires composing natural language instructions called prompts to elicit knowledge from LLMs in a structured way. Unlike previous state-of-the-art (SoTA) models, prompt engineering does not require extensive parameter re-training or fine-tuning based on the given NLP task and thus solely operates on the embedded knowledge of LLMs. Additionally, LLM enthusiasts can intelligently extract LLMs' knowledge through a basic natural language conversational exchange or prompt engineering, allowing more and more people even without deep mathematical machine learning background to experiment with LLMs. With prompt engineering gaining popularity in the last two years, researchers have come up with numerous engineering techniques around designing prompts to improve accuracy of information extraction from the LLMs. In this paper, we summarize different prompting techniques and club them together based on different NLP tasks that they have been used for. We further granularly highlight the performance of these prompting strategies on various datasets belonging to that NLP task, talk about the corresponding LLMs used, present a taxonomy diagram and discuss the possible SoTA for specific datasets. In total, we read and present a survey of 44 research papers which talk about 39 different prompting methods on 29 different NLP tasks of which most of them have been published in the last two years.

Towards a Catalog of Prompt Patterns to Enhance the Discipline of Prompt Engineering

A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT

Exploring Prompt Engineering Practices in the Enterprise

Towards Goal-oriented Prompt Engineering for Large Language Models: A Survey

A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications

Exploring Prompt Engineering: A Systematic Review with SWOT Analysis

Unleashing the potential of prompt engineering in Large Language Models: a comprehensive review

The Prompt Canvas: A Literature-Based Practitioner Guide for Creating Effective Prompts in Large Language Models

Prompting Frameworks for Large Language Models: A Survey

An Empirical Categorization of Prompting Techniques for Large Language Models: A Practitioner's Guide

A Survey of Prompt Engineering Methods in Large Language Models for Different NLP Tasks

Why Johnny Can't Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts.

Prompt Design and Engineering: Introduction and Advanced Methods

Prompting in the Wild: An Empirical Study of Prompt Evolution in Software Repositories

Revisiting Prompt Engineering via Declarative Crowdsourcing

Prompts Matter: Insights and Strategies for Prompt Engineering in Automated Software Traceability

RePrompt: Planning by Automatic Prompt Engineering for Large Language Models Agents

A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models

Prompt Engineering as an Important Emerging Skill for Medical Professionals: Tutorial

Prompt engineering paradigms for medical applications: scoping review and recommendations for better practices

What Should We Engineer in Prompts? Training Humans in Requirement-Driven LLM Use