Abstract:Cutmix-based data augmentation, which uses a cut-and-paste strategy, has shown remarkable generalization capabilities in deep learning. However, existing methods primarily consider global semantics with image-level constraints, which excessively reduces attention to the discriminative local context of the class and leads to a performance improvement bottleneck. Moreover, existing methods for generating augmented samples usually involve cutting and pasting rectangular or square regions, resulting in a loss of object part information. To mitigate the problem of inconsistency between the augmented image and the generated mixed label, existing methods usually require double forward propagation or rely on an external pre-trained network for object centering, which is inefficient. To overcome the above limitations, we propose LGCOAMix, an efficient context-aware and object-part-aware superpixel-based grid blending method for data augmentation. To the best of our knowledge, this is the first time that a label mixing strategy using a superpixel attention approach has been proposed for cutmix-based data augmentation. It is the first instance of learning local features from discriminative superpixel-wise regions and cross-image superpixel contrasts. Extensive experiments on various benchmark datasets show that LGCOAMix outperforms state-of-the-art cutmix-based data augmentation methods on classification tasks, and weakly supervised object location on CUB200-2011. We have demonstrated the effectiveness of LGCOAMix not only for CNN networks, but also for Transformer networks. Source codes are available at https://github.com/DanielaPlusPlus/LGCOAMix.

RobustMixGen: Data augmentation for enhancing robustness of visual-language models in the presence of distribution shift

MixGen: A New Multi-Modal Data Augmentation

GenMix: Effective Data Augmentation with Generative Diffusion Model Image Editing

Robustmix: Improving Robustness by Regularizing the Frequency Bias of Deep Nets

RC-Mixup: A Data Augmentation Strategy against Noisy Data for Regression Tasks

DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification

LGCOAMix: Local and Global Context-and-Object-Part-Aware Superpixel-Based Data Augmentation for Deep Visual Recognition

DiffuseMix: Label-Preserving Data Augmentation with Diffusion Models

AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty

Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning

Toward Robustness in Multi-label Classification: A Data Augmentation Strategy against Imbalance and Noise

NeighborMix Data Augmentation for Image Recognition

AugMax: Adversarial Composition of Random Augmentations for Robust Training

Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning

MixBoost: Improving the Robustness of Deep Neural Networks by Boosting Data Augmentation

MixACM: Mixup-Based Robustness Transfer via Distillation of Activated Channel Maps

RandoMix: a mixed sample data augmentation method with multiple mixed modes

MiAMix: Enhancing Image Classification through a Multi-stage Augmented Mixed Sample Data Augmentation Method

VideoMix: Rethinking Data Augmentation for Video Classification

A New Data Augmentation Method Based on Mixup and Dempster-Shafer Theory

CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features