Abstract:It has been demonstrated that the art of prompt tuning is highly effective in efficiently extracting knowledge from pretrained foundation models, encompassing pretrained language models (PLMs), vision pretrained models, and vision-language (V-L) models. However, the efficacy of employing fixed soft prompts with a predetermined position for concatenation with inputs for all instances, irrespective of their inherent disparities, remains uncertain. Variables such as the position, length, and representations of prompts across diverse instances and tasks can substantially influence the performance of prompt tuning. In this context, we provide a theoretical analysis, which reveals that optimizing the position of the prompt to encompass the input can capture additional semantic information that traditional prefix or postfix prompt tuning methods fail to capture. Building upon our analysis, we present a unified dynamic prompt (DP) tuning strategy that dynamically determines different factors of prompts based on specific tasks and instances. To accomplish this, we employ a lightweight learning network with Gumble-Softmax, allowing us to learn instance-dependent guidance. Experimental results underscore the significant performance improvement achieved by dynamic prompt tuning across a wide range of tasks, including NLP tasks, vision recognition tasks, and vision-language tasks. Furthermore, we establish the universal applicability of our approach under full-data, few-shot, and multitask scenarios. Codes are available at <a class="link-external link-https" href="https://github.com/Xianjun-Yang/DPT" rel="external noopener nofollow">this https URL</a>.

Structured Prompt Tuning

Dynamic Prompting: A Unified Framework for Prompt Tuning

Efficient Prompt Tuning by Multi-Space Projection and Prompt Fusion

APrompt: Attention Prompt Tuning for Efficient Adaptation of Pre-trained Language Models

Global Prompt Cell: A Portable Control Module for Effective Prompt Tuning

Improving Prompt Tuning with Learned Prompting Layers

SuperPos-Prompt: Enhancing Soft Prompt Tuning of Language Models with Superposition of Multi Token Embeddings

Subgraph-level Universal Prompt Tuning

LIPT: Improving Prompt Tuning with Late Inception Reparameterization

Prompt Tuning for Unified Multimodal Pretrained Models.

P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks

P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks

Decomposed Prompt Tuning via Low-Rank Reparameterization

InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding

PPT: Pre-trained Prompt Tuning for Few-shot Learning

Instance-wise Prompt Tuning for Pretrained Language Models

Enhancing Few-Shot Transfer Learning with Optimized Multi-Task Prompt Tuning through Modular Prompt Composition

STT: Soft Template Tuning for Few-Shot Adaptation

Prompt Tuning for Generative Multimodal Pretrained Models

Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning

Universality and Limitations of Prompt Tuning