Abstract:To train a model in a traditional supervised learning classification system for natural language processing (NLP) tasks, it is essential to have labeled data, which is not present in large amounts for many tasks. Prompt-based learning methods attempt to combat the supervised learning need for labeled data by directly adapting pre-trained language models and modeling the probability of text itself. In this paper, we propose a novel data-agnostic strategy for prompt-based fine-tuning that leverages feature moments (a.k.a., mean and standard deviation) as a data augmentation technique and employs training dynamics (i.e., confidence and variability) to allow more informative samples to be concatenated for generating demonstrations as input context. Our approach is a strong method for few-shot learning that forces the language model to pay special attention to the feature moments and allows more informative samples to be concatenated for generating demonstrations as input context by selecting high confidence and low variance samples. To demonstrate its effectiveness given limited training data, we conduct extensive experiments in different few-shot settings on three empathy and emotion classification datasets (from various domains). We further evaluate our method's robustness by introducing noise to our few-shot input data and labels and show that exchanging moments between samples and incorporating cartography-based demonstrations are beneficial when the available data is limited and noisy.

Adaptive Prompt Learning-Based Few-Shot Sentiment Analysis

PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners

A Soft Contrastive Learning-based Prompt Model for Few-shot Sentiment Analysis

Self-supervised Meta-Prompt Learning with Meta-Gradient Regularization for Few-shot Generalization

AdaPrompt: Adaptive Model Training for Prompt-based NLP

Prompting-based Synthetic Data Generation for Few-Shot Question Answering

STPrompt: Semantic-guided and Task-driven prompts for Effective Few-shot Classification

Unified Prompt Learning Makes Pre-Trained Language Models Better Few-Shot Learners

Prompt-Based Meta-Learning for Few-shot Text Classification.

Ontology-enhanced Prompt-tuning for Few-shot Learning

Syntax-aware Hybrid prompt model for Few-shot multi-modal sentiment analysis

Aggregate-and-Adapt Natural Language Prompts for Downstream Generalization of CLIP

Supervised and Few-Shot Learning for Aspect-Based Sentiment Analysis of Instruction Prompt

Feature Normalization and Cartography-Based Demonstrations for Prompt-Based Fine-Tuning on Emotion-Related Tasks

Retrieval-Enhanced Visual Prompt Learning for Few-shot Classification

Semantic Prompt for Few-Shot Image Recognition

Few-shot Joint Multimodal Aspect-Sentiment Analysis Based on Generative Multimodal Prompt

Fairness-guided Few-shot Prompting for Large Language Models

PromptAD: Learning Prompts with only Normal Samples for Few-Shot Anomaly Detection

ConsPrompt: Exploiting Contrastive Samples for Fewshot Prompt Learning

Template-Free Prompting for Few-Shot Named Entity Recognition via Semantic-Enhanced Contrastive Learning