Abstract:Recent studies have shown that prompt-based fine-tuning improves the performance of large Pre-trained Language Models (PLMs) for few-shot text classification. Specifically, this type of method transforms the text classification task into the inherent Masked Language Modeling (MLM) with some natural language prompts and verbalizers to bridge the gap between the pre-training stage and the fine-tuning stage. Yet, it is unclear how the prompting knowledge can be transferred across similar or distant NLP tasks, for the purpose of mutual reinforcement. Based on continuous prompt embeddings, we propose TransPrompt v2 , a novel transferable prompting framework for few-shot learning across similar or distant text classification tasks. For transferable prompt learning across similar tasks, we employ a multi-task meta-knowledge acquisition procedure to train a meta-learner that captures the cross-task transferable knowledge. For learning across distant tasks, we further introduce the task type descriptions and propose intra-type and inter-type prompt encoders to capture implicit mutual relations among multiple distant tasks. Additionally, two de-biasing techniques are further designed to make the trained meta-learner more task-agnostic and unbiased towards any tasks. After that, the meta-learner can be fine-tuned for specific tasks with better parameters initialization. Extensive experiments show that TransPrompt v2 outperforms single-task and cross-task strong baselines over multiple NLP tasks and datasets. We further show that the meta-learner can effectively improve the performance of PLMs on previously unseen tasks. In addition, TransPrompt v2 also outperforms strong fine-tuning baselines when learning with full training sets.

MsPrompt: Multi-step Prompt Learning for Debiasing Few-Shot Event Detection

The Art of Prompting: Event Detection based on Type Specific Prompts

STPrompt: Semantic-guided and Task-driven prompts for Effective Few-shot Classification

Few-shot Event Detection: An Empirical Study and a Unified View

Retrieval-Enhanced Visual Prompt Learning for Few-shot Classification

AdaPrompt: Adaptive Model Training for Prompt-based NLP

Zero- and Few-Shot Event Detection via Prompt-Based Meta Learning

Meta-Learning with Dynamic-Memory-Based Prototypical Network for Few-Shot Event Detection.

Ontology-enhanced Prompt-tuning for Few-shot Learning

Self-Prompting Perceptual Edge Learning for Dense Prediction

KiPT: Knowledge-injected Prompt Tuning for Event Detection.

Learning Event Representations for Zero-Shot Detection via Dual-Contrastive Prompting

ConsPrompt: Exploiting Contrastive Samples for Fewshot Prompt Learning

Episode-Based Prompt Learning for Any-Shot Intent Detection.

PromptCL: Improving Event Representation via Prompt Template and Contrastive Learning

Adaptive Prompt Learning-Based Few-Shot Sentiment Analysis

Discriminative Language Model as Semantic Consistency Scorer for Prompt-based Few-Shot Text Classification

TransPrompt V2: Transferable Prompt-based Fine-tuning for Few-shot Text Classification

HybridPrompt: Domain-Aware Prompting for Cross-Domain Few-Shot Learning

Towards Unified Prompt Tuning for Few-shot Text Classification

Mixture-of-Prompt-Experts for Multi-modal Semantic Understanding