Abstract:Few-shot sequence labeling is a general problem formulation for many natural language understanding tasks in data-scarcity scenarios, which require models to generalize to new types via only a few labeled examples. Recent advances mostly adopt metric-based meta-learning and thus face the challenges of modeling the miscellaneous Other prototype and the inability to generalize to classes with large domain gaps. To overcome these challenges, we propose a decomposed meta-learning framework for few-shot sequence labeling that breaks down the task into few-shot mention detection and few-shot type classification, and sequentially tackles them via meta-learning. Specifically, we employ model-agnostic meta-learning (MAML) to prompt the mention detection model to learn boundary knowledge shared across types. With the detected mention spans, we further leverage the MAML-enhanced span-level prototypical network for few-shot type classification. In this way, the decomposition framework bypasses the requirement of modeling the miscellaneous Other prototype. Meanwhile, the adoption of the MAML algorithm enables us to explore the knowledge contained in support examples more efficiently, so that our model can quickly adapt to new types using only a few labeled examples. Under our framework, we explore a basic implementation that uses two separate models for the two subtasks. We further propose a joint model to reduce model size and inference time, making our framework more applicable for scenarios with limited resources. Extensive experiments on nine benchmark datasets, including named entity recognition, slot tagging, event detection, and part-of-speech tagging, show that the proposed approach achieves start-of-the-art performance across various few-shot sequence labeling tasks.

Decomposed Meta-Learning for Few-Shot Sequence Labeling

Decomposed Meta-Learning for Few-Shot Named Entity Recognition

Revisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks

When Low Resource NLP Meets Unsupervised Language Model: Meta-Pretraining then Meta-Learning for Few-Shot Text Classification (Student Abstract)

Meta Self-training for Few-shot Neural Sequence Labeling

Meta-Learning for Semi-Supervised Few-Shot Classification

Coarse-to-Fine Pseudo-Labeling Guided Meta-Learning for Few-Shot Classification

Unsupervised meta-learning for few-shot learning

Meta-Information Guided Meta-Learning for Few-Shot Relation Classification.

Adaptive Self-training for Few-shot Neural Sequence Labeling

Meta-Seg: A Generalized Meta-Learning Framework for Multi-Class Few-Shot Semantic Segmentation.

Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning

Meta Learning to Bridge Vision and Language Models for Multimodal Few-Shot Learning

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification.

Pseudo-Labeling Based Practical Semi-Supervised Meta-Training for Few-Shot Learning

MCML: A Novel Memory-based Contrastive Meta-Learning Method for Few Shot Slot Tagging

Few-shot Learning with Meta Metric Learners

Meta-Prototypical Learning for Domain-Agnostic Few-Shot Recognition

ML-FDA: Meta-Learning via Feature Distribution Alignment for Few-Shot Learning