Abstract:It has been demonstrated that the art of prompt tuning is highly effective in efficiently extracting knowledge from pretrained foundation models, encompassing pretrained language models (PLMs), vision pretrained models, and vision-language (V-L) models. However, the efficacy of employing fixed soft prompts with a predetermined position for concatenation with inputs for all instances, irrespective of their inherent disparities, remains uncertain. Variables such as the position, length, and representations of prompts across diverse instances and tasks can substantially influence the performance of prompt tuning. In this context, we provide a theoretical analysis, which reveals that optimizing the position of the prompt to encompass the input can capture additional semantic information that traditional prefix or postfix prompt tuning methods fail to capture. Building upon our analysis, we present a unified dynamic prompt (DP) tuning strategy that dynamically determines different factors of prompts based on specific tasks and instances. To accomplish this, we employ a lightweight learning network with Gumble-Softmax, allowing us to learn instance-dependent guidance. Experimental results underscore the significant performance improvement achieved by dynamic prompt tuning across a wide range of tasks, including NLP tasks, vision recognition tasks, and vision-language tasks. Furthermore, we establish the universal applicability of our approach under full-data, few-shot, and multitask scenarios. Codes are available at <a class="link-external link-https" href="https://github.com/Xianjun-Yang/DPT" rel="external noopener nofollow">this https URL</a>.

LIPT: Improving Prompt Tuning with Late Inception Reparameterization

LoPT: Low-Rank Prompt Tuning for Parameter Efficient Language Models

FPT: Improving Prompt Tuning Efficiency Via Progressive Training.

Late Prompt Tuning: A Late Prompt Could Be Better Than Many Prompts

IAPT: Instruction-Aware Prompt Tuning for Large Language Models

IAPT: Instance-Aware Prompt Tuning for Large Language Models

Improving Prompt Tuning with Learned Prompting Layers

Efficient Prompt Tuning by Multi-Space Projection and Prompt Fusion

Instance-wise Prompt Tuning for Pretrained Language Models

APrompt: Attention Prompt Tuning for Efficient Adaptation of Pre-trained Language Models

SPT: Learning to Selectively Insert Prompts for Better Prompt Tuning

Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt Adaptation

Dynamic Prompting: A Unified Framework for Prompt Tuning

XPrompt: Exploring the Extreme of Prompt Tuning

Parameter Efficient Multi-task Fine-tuning by Learning to Transfer Token-wise Prompts

Exploring Low-dimensional Intrinsic Task Subspace Via Prompt Tuning.

P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks

Approximated Prompt Tuning for Vision-Language Pre-trained Models

Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning

Exploring Universal Intrinsic Task Subspace Via Prompt Tuning

P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks