Abstract:Mixup is an efficient data augmentation approach that improves the generalization of neural networks by smoothing the decision boundary with mixed data. Recently, dynamic mixup methods have improved previous static policies effectively (e.g., linear interpolation) by maximizing target-related salient regions in mixed samples, but excessive additional time costs are not acceptable. These additional computational overheads mainly come from optimizing the mixed samples according to the mixed labels. However, we found that the extra optimizing step may be redundant because label-mismatched mixed samples are informative hard mixed samples for deep models to localize discriminative features. In this paper, we thus are not trying to propose a more complicated dynamic mixup policy but rather an efficient mixup objective function with a decoupled regularizer named Decoupled Mixup (DM). The primary effect is that DM can adaptively utilize those hard mixed samples to mine discriminative features without losing the original smoothness of mixup. As a result, DM enables static mixup methods to achieve comparable or even exceed the performance of dynamic methods without any extra computation. This also leads to an interesting objective design problem for mixup training that we need to focus on both smoothing the decision boundaries and identifying discriminative features. Extensive experiments on supervised and semi-supervised learning benchmarks across seven datasets validate the effectiveness of DM as a plug-and-play module. Source code and models are available at https://github.com/Westlake-AI/openmixup

Probabilistic Interpolation with Mixup Data Augmentation for Text Classification

DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification

Mixup Augmentation with Multiple Interpolations

Augmenting Data with Mixup for Sentence Classification: an Empirical Study

Decoupled Mixup for Data-efficient Learning

Unveiling the Power of Mixup for Stronger Classiﬁers

MSMix:An Interpolation-Based Text Data Augmentation Method Manifold Swap Mixup

Mixup-transformer: Dynamic data augmentation for NLP tasks

Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks

Global Mixup: Eliminating Ambiguity with Clustering.

A New Data Augmentation Method Based on Mixup and Dempster-Shafer Theory

ASMix: an Attention-based Smooth Data Augmentation Approach.

Harnessing Hard Mixed Samples with Decoupled Regularizer

Mixing Approach for Text Data Augmentation Based on an Ensemble of Explainable Artificial Intelligence Methods

PointMixup: Augmentation for Point Clouds

AMPLIFY:Attention-based Mixup for Performance Improvement and Label Smoothing in Transformer

ITMix: Image-Text Mix Augmentation for Transferring CLIP to Image Classification

MixupE: Understanding and Improving Mixup from Directional Derivative Perspective

TransformMix: Learning Transformation and Mixing Strategies from Data

ShuffleMix: Improving Representations via Channel-Wise Shuffle of Interpolated Hidden States

Infinite Class Mixup