Abstract:In prediction tasks, there exist features that are related to the label in the same way across different settings for that task; these are semantic features or semantics. Features with varying relationships to the label are nuisances. For example, in detecting cows from natural images, the shape of the head is semantic but because images of cows often have grass backgrounds but not always, the background is a nuisance. Models that exploit nuisance-label relationships face performance degradation when these relationships change. Building models robust to such changes requires additional knowledge beyond samples of the features and labels. For example, existing work uses annotations of nuisances or assumes ERM-trained models depend on nuisances. Approaches to integrate new kinds of additional knowledge enlarge the settings where robust models can be built. We develop an approach to use knowledge about the semantics by corrupting them in data, and then using the corrupted data to produce models which identify correlations between nuisances and the label. Once these correlations are identified, they can be used to adjust for where nuisances drive predictions. We study semantic corruptions in powering different spurious-correlation avoiding methods on multiple out-of-distribution (OOD) tasks like classifying waterbirds, natural language inference (NLI), and detecting cardiomegaly in chest X-rays.

Mitigating Spurious Correlations in Named Entity Recognition Models Through Counterfactual Data Augmentation

Counterfactual Generator: A Weakly-Supervised Method for Named Entity Recognition

Relation-based Counterfactual Data Augmentation and Contrastive Learning for Robustifying Natural Language Inference Models

A Rationale-centric Counterfactual Data Augmentation Method for Cross-Document Event Coreference Resolution

Data Augmentation for Cross-Domain Named Entity Recognition

Nuisances via Negativa: Adjusting for Spurious Correlations via Data Augmentation

Mitigating Out-of-Entity Errors in Named Entity Recognition: A Sentence-Level Strategy

Reducing Spurious Correlations for Relation Extraction by Feature Decomposition and Semantic Augmentation

An improved data augmentation approach and its application in medical named entity recognition

3Rs:Data Augmentation Techniques Using Document Contexts For Low-Resource Chinese Named Entity Recognition

Automatically Generating Counterfactuals for Relation Classification

Domain-Specific NER Via Retrieving Correlated Samples

Composited-Nested-Learning with Data Augmentation for Nested Named Entity Recognition

Learning Robust Named Entity Recognizers From Noisy Data With Retrieval Augmentation

Enhancing NER with Sentence-Level Entity Detection As an Simple Auxiliary Task

SENCR: A Span Enhanced Two-Stage Network with Counterfactual Rethinking for Chinese NER

LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition

Structure and Label Constrained Data Augmentation for Cross-domain Few-shot NER

Cascaded Models for Better Fine-Grained Named Entity Recognition

Mitigating Spurious Correlations in Multi-modal Models during Fine-tuning

An Experimental Study on Data Augmentation Techniques for Named Entity Recognition on Low-Resource Domains