Abstract:To train a model in a traditional supervised learning classification system for natural language processing (NLP) tasks, it is essential to have labeled data, which is not present in large amounts for many tasks. Prompt-based learning methods attempt to combat the supervised learning need for labeled data by directly adapting pre-trained language models and modeling the probability of text itself. In this paper, we propose a novel data-agnostic strategy for prompt-based fine-tuning that leverages feature moments (a.k.a., mean and standard deviation) as a data augmentation technique and employs training dynamics (i.e., confidence and variability) to allow more informative samples to be concatenated for generating demonstrations as input context. Our approach is a strong method for few-shot learning that forces the language model to pay special attention to the feature moments and allows more informative samples to be concatenated for generating demonstrations as input context by selecting high confidence and low variance samples. To demonstrate its effectiveness given limited training data, we conduct extensive experiments in different few-shot settings on three empathy and emotion classification datasets (from various domains). We further evaluate our method's robustness by introducing noise to our few-shot input data and labels and show that exchanging moments between samples and incorporating cartography-based demonstrations are beneficial when the available data is limited and noisy.

Prompt Based CVAE Data Augmentation for Few-Shot Intention Detection

Cloze-Style Data Augmentation for Few-Shot Intent Recognition

PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners

Few-Shot Intent Detection by Data Augmentation and Class Knowledge Transfer

Enhancing Few-shot NER with Prompt Ordering based Data Augmentation

Prompting-based Synthetic Data Generation for Few-Shot Question Answering

Prompt Learning for Few-Shot Question Answering Via Self-Context Data Augmentation

A Deep Learning Model with Data Enrichment for Intent Detection and Slot Filling

Generate then Refine: Data Augmentation for Zero-shot Intent Detection

LM-CPPF: Paraphrasing-Guided Data Augmentation for Contrastive Prompt-Based Few-Shot Fine-Tuning

Prompt-Based Data Augmentation Framework for Few-Shot Named Entity Recognition

Self-Supervised Task Augmentation for Few-Shot Intent Detection

Few-shot Joint Multimodal Aspect-Sentiment Analysis Based on Generative Multimodal Prompt

A Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification

PromDA: Prompt-based Data Augmentation for Low-Resource NLU Tasks

PromptAD: Learning Prompts with only Normal Samples for Few-Shot Anomaly Detection

Adaptive Prompt Learning-Based Few-Shot Sentiment Analysis

AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentation

Episode-Based Prompt Learning for Any-Shot Intent Detection.

Feature Normalization and Cartography-Based Demonstrations for Prompt-Based Fine-Tuning on Emotion-Related Tasks

Generating Synthetic Datasets for Few-shot Prompt Tuning