Abstract:To address the issues of MixUp and its variants (e.g., Manifold MixUp) in image classification tasks-namely, their neglect of mixing within the same class (intra-class mixup) and their inadequacy in enhancing intra-class cohesion through their mixing operations-we propose a novel mixup method named SynerMix-Intra and, building upon this, introduce a synergistic mixup solution named SynerMix. SynerMix-Intra specifically targets intra-class mixup to bolster intra-class cohesion, a feature not addressed by current mixup methods. For each mini-batch, it leverages feature representations of unaugmented original images from each class to generate a synthesized feature representation through random linear interpolation. All synthesized representations are then fed into the classification and loss layers to calculate an average classification loss that significantly enhances intra-class cohesion. Furthermore, SynerMix combines SynerMix-Intra with an existing mixup approach (e.g., MixUp, Manifold MixUp), which primarily focuses on inter-class mixup and has the benefit of enhancing inter-class separability. In doing so, it integrates both inter- and intra-class mixup in a balanced way while concurrently improving intra-class cohesion and inter-class separability. Experimental results on six datasets show that SynerMix achieves a 0.1% to 3.43% higher accuracy than the best of either MixUp or SynerMix-Intra alone, averaging a 1.16% gain. It also surpasses the top-performer of either Manifold MixUp or SynerMix-Intra by 0.12% to 5.16%, with an average gain of 1.11%. Given that SynerMix is model-agnostic, it holds significant potential for application in other domains where mixup methods have shown promise, such as speech and text classification. Our code is publicly available at:

AutoMix: Unveiling the Power of Mixup for Stronger Classifiers

Unveiling the Power of Mixup for Stronger Classiﬁers

Adversarial AutoMixup

OpenMixup: A Comprehensive Mixup Benchmark for Visual Classification

Harnessing Hard Mixed Samples with Decoupled Regularizer

AutoMix: Mixup Networks for Sample Interpolation via Cooperative Barycenter Learning

Decoupled Mixup for Data-efficient Learning

MiAMix: Enhancing Image Classification through a Multi-stage Augmented Mixed Sample Data Augmentation Method

SynerMix: Synergistic Mixup Solution for Enhanced Intra-Class Cohesion and Inter-Class Separability in Image Classification

TransformMix: Learning Transformation and Mixing Strategies from Data

OpenMixup: Open Mixup Toolbox and Benchmark for Visual Representation Learning

C-Mixup: Improving Generalization in Regression

MixupE: Understanding and Improving Mixup from Directional Derivative Perspective

Expeditious Saliency-guided Mix-up through Random Gradient Thresholding

Boosting Discriminative Visual Representation Learning with Scenario-Agnostic Mixup

mixup: Beyond Empirical Risk Minimization

MetaMixUp: Learning Adaptive Interpolation Policy of MixUp with Meta-Learning

Understanding Mixup Training Methods

Mixup Without Hesitation

Global Mixup: Eliminating Ambiguity with Clustering.

Infinite Class Mixup