Abstract:Cutmix-based data augmentation, which uses a cut-and-paste strategy, has shown remarkable generalization capabilities in deep learning. However, existing methods primarily consider global semantics with image-level constraints, which excessively reduces attention to the discriminative local context of the class and leads to a performance improvement bottleneck. Moreover, existing methods for generating augmented samples usually involve cutting and pasting rectangular or square regions, resulting in a loss of object part information. To mitigate the problem of inconsistency between the augmented image and the generated mixed label, existing methods usually require double forward propagation or rely on an external pre-trained network for object centering, which is inefficient. To overcome the above limitations, we propose LGCOAMix, an efficient context-aware and object-part-aware superpixel-based grid blending method for data augmentation. To the best of our knowledge, this is the first time that a label mixing strategy using a superpixel attention approach has been proposed for cutmix-based data augmentation. It is the first instance of learning local features from discriminative superpixel-wise regions and cross-image superpixel contrasts. Extensive experiments on various benchmark datasets show that LGCOAMix outperforms state-of-the-art cutmix-based data augmentation methods on classification tasks, and weakly supervised object location on CUB200-2011. We have demonstrated the effectiveness of LGCOAMix not only for CNN networks, but also for Transformer networks. Source codes are available at https://github.com/DanielaPlusPlus/LGCOAMix.

Saliency detection-guided for image data augmentation

Efficient Classification Using Salient Regions

Color boosted visual saliency detection and its application to image classification

Saliency information and mosaic based data augmentation method for densely occluded object recognition

Data Augmentation via Latent Diffusion for Saliency Prediction

SaliencyCut: Augmenting Plausible Anomalies for Anomaly Detection

Gradsalmix: gradient saliency-based mix for image data augmentation

Saliency Guided Contrastive Learning on Scene Images

Multilevel Saliency-Guided Self-Supervised Learning for Image Anomaly Detection

Multi-Scale Feature Enhancement for Saliency Object Detection Algorithm

KeepOriginalAugment: Single Image-based Better Information-Preserving Data Augmentation Approach

Fine-Grained Image Classification Via Spatial Saliency Extraction.

CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features

LGCOAMix: Local and Global Context-and-Object-Part-Aware Superpixel-Based Data Augmentation for Deep Visual Recognition

Online image augmentation via regional cross-attention

Exploring Data Augmentations on Self-/Semi-/Fully- Supervised Pre-trained Models

Saliency Detection Based on Multiple-Level Feature Learning

PCSalmix: Gradient Saliency-Based Mix Augmentation for Point Cloud Classification

Adaptive saliency cuts

Iterative Saliency Enhancement using Superpixel Similarity

Saliency Cuts Based on Adaptive Triple Thresholding.